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ABSTRACT 


This  document  presents  a  generalised,  integrated  conceptual  approach  to 
the  major  steps  involved  in  estimating  the  cost?  o*  a  military  system.  The 
approach  is  generalised  in  the  sense  that  the  document  identifies  the  common 
methodological  problems  and  tasks  involved  in  costing  all  military  systems. 
Hie  approach  is  integrated  in  the  sense  of  discussing  the  entire  process  of 
coating  a  system  from  baginning  to  end  and  in  showing  the  methodological 
relationships  of  each  sequential  step  to  preceding  and  subsequent  steps.  The 
approach  is  conceptual  in  the  sense  that  fundamental  principles  are  stressed 
ss  opposed  to  a  catalog  of  resource  costs  and  estimating  relationships  or  a 
case  book  detailing  the  specific  procedures  used  to  cost  particular  systems  in 
the  past. 

Notwithstanding  its  conceptual  orientation,  the  approach  in  thf>a  study  la 
task  oriented  in  the  sense  that  discussion  centers  around  such  highly  practical 
questions  as  the  following:  what  an  analyst  should  learn  about  the  client's 
intended  application  of  the  estimate  and  about  the  details  of  the  system  he  is  to 
coot  before  he  begins  the  costing  task  itself;  the  criteria  an  analyst  can  use  to 
help  him  realize  the  greatest  benefit  from  the  limited  time  he  normally  has 
available  to  make  the  estimate;  the  types  of  activities  and  resources  he  should 
cost  and  in  what  detail;  the  types  of  data  he  should  seek  as  s  basis  to  cost  such 
activities  and  recourses,  and  the  sources  from  which  he  should  try  lo  collect 
these  data;  how  he  should  proceed  to  evaluate  and  synthesize  his  data  inputs  to 
arrive  at  his  system  cost  estimate;  how  he  should  present  the  details  of  his 
findings  so  that  they  will  be  most  meaningful  to  his  client  and  not  be 
misinterpreted. 
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PREFACE 
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appreciation  for  the  many,  valuable  comments  received  from  the  following 
D-53  staff  who  reviewed  and  commented  on  the  initial  draft:  Frank  V. 

A 'Hearn,  Ahti  E.  Autio,  Joseph  M.  Cappellett*.  Richard  M.  Dun tine, 

Charles  S.  Enright,  John  A.  Evans  (now  with  MITRE's  Information  Sciences 
Department),  Harold  Claaer,  Robert  L.  Hamilton,  Thomas  J.  Jannsen, 

Eugene  D.  Lund berg,  William  Marcuse,  James  R.  Miller,  III,  Lee  R.  Morris, 
William  C.  Morsch,  Robert  L.  Murphy,  Herbert  B.  Roseman,  David  F.  Votaw,  Jr., 
Carter  F.  Wolfe. 

The  writer  is  especially  indebted  to  Dr.  Norman  Waks,  Special  Assistant 
for  Economics  and  Systems  Acquisition  to  MITRE's  Vice  President  for 
Technical  Operations,  and  to  Mr.  Eugene  D.  Lundberg,  Head  of  MITRE's 
Systems  Analysis  Department,  not  only  for  their  generous  administrative 
support  and  technical  counsel,  but  also  for  the  personal  interest  they 
have  maintained  in  this  undertaking  from  its  inception  through  its 
present  formulation. 

Footnotes  in  this  document  are  used,  alaust  exclusively,  to  identify 
source  references.  To  facilitate  reading,  these  footnotes  have  been 
consolidated,  with  a  few  rare  exceptions,  at  the  end  of  each  chapter 
rather  than  at  the  bottom  of  the  page  on  which  the  reference  is  cited. 

The  applicable  page  in  the  text  to  which  the  footnote  applies  is 
identified  in  the  right  hand  smrgin  of  the  footnote  page. 
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1.1  fyrg-PM 

This  paper  alas  to  present  a  generalized,  integrated,  conceptual 

I 

picture  of  the  aajor  steps  involved  in  costing  large-scale  allitary  systems. 

| 

The  approach  in  this  study  is  generalized  in  the  sense  that  it  seeks  to 
Identify  the  common  aethodological  probleas  and  tasks  Involved  in  costing 
all  large  allitary  systaas.  In  fact,  the  aethodology  seeks  to  be  even 

“t 

skore  generalized  in  that  it  also  alas  to  be  potentially  applicable  to 

j 

estiaatlng  the  coses  of  modern  space  systems  and  other  coop lex  public  or 
private  civilian  undertakings  (see  pp.  19-20). 

The  approach  seeks  to  be  integrated  in  the  sense  of  discussing  the 
entire  process  of  costing  a  system  fro®  ttz  beginning  of  its  life  cycle  to 
the  end  and  in  shoving  the  aethodological  relationships  of  each  sequential 
step  to  preceding  and  subsequent  steps. 

(  The  approach  is  conceptualized  in  the  sense  that  fundamental  principles 
are  stressed  as  opposed  to  a  catalog  of  resource  costs  and  es tins ting 
relationships  or  a  case  book  detailing  historically  the  specific  procedures 
used  to  cost  particular  systems  in  the  past.  In  other  words,  the  document 
does  not  provide  a  detailed  cost ing  "cook  book",  a  self-contained  set  of 
hov-to-do-it  costing  slgorlthas.  Questions  of  why  and  when  to  use  a  given 
costing  procedure  are  usually  accorded  equal  attention  with  questions  of 
hov  to  use  the  procedure. 

Finally,  this  docuacnt  is  an  interim  report.  Illustrative  of  suiterial 
to  be  covered  in  a  subsequent  edition  are  the  following: 
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a.  fuller  and  sore  numerous  examples  will  be  provided  to  illustrate 
soaic  of  the  theoretical  concepts  set  forth  in  Che  present  study. 
These  examples  will  drew  fros  case  histories,  from  advanced 
planning  studies  of  particular  system* .  and  froa  actual  system 
cost  experiences  to  illustrate  the  relevance  and  interface  of  the 
concepts  outlined  in  this  document 

b.  A  subsequent  edition  will  also  auke  use  of  extensive  graphic  and 
visual  material  to  supplement  the  almost  purely  verbal  exposition 
of  the  present  document. 

e.  A  subsequent  edition,  perhaps  a  companion  study,  will  provide  a 
data-base  complement  that  will  facilitate  the  use  of  the 
methodological  concepts  set  forth  in  this  document. 

d.  A  later  edition  or  study  will  consider  in  siore  detail  a  matter 

only  lishtly  touched  on  in  the  final  chapter  of  the  present  study; 
namely,  the  potentialities  and  limitations  of  system  analysis, 
including  cost  analysis,  as  a  tool  of  decision  making. 

The  paper  la  directed  to  three  types  of  audiences,  first,  it  aims  to 
be  useful  as  a  training  aid  for  newly  recruited  members  of  the  system 
costing  profession.  Second,  it  is  addressed  to  the  clients  of  the  system 
cost  analyst.  By  acquainting  them  with  the  problems  that  confront  the 
cost  analyst.  It  is  hoped  that  they  will  better  appreciate  both  the 
potentialities  and  limitations  of  the  cost  estimate.  Third,  it  is  hoped 
that  the  document  will  be  helpful  to  professional  cost  analysts, including 
system  cost  amthodologlsts,  as  a  frame  of  reference  for  developing  new 
and  better  methods  of  estistating  military  system  costs  in  the  future. 
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1.2 


Eesource:  A  resource,  es  defined  here,  is  eny  limited  supply,  natural 
or  Manufactured  Material  or  agent  useful  either  directly  or  indirectly 
when  employed  in  combination  with  other  materials  or  agents  to  satisfy  a 
personal  or  social  objective,  ficamples  of  resources  as  used  in  this 
document:  equipment,  buildings,  personnel  services,  etc. 

Cost:  A  cost  is  a  resource  drain,  the  commitment  of  a  valuable, 
limited-supply, multi-use  material  or  agent  to  a  specified  use.  The  concept 
of  cost  is  both  basic ‘and  complex.  It  will  be  discussed  frequently  through¬ 
out  this  document,  expecially  in  Chapters  2  and  8. 

Effectiveness:  Effectiveness  is  a  value  concept.  As  used  here,  it 
represents  the  value  or  worth  placed  upon  designated  attributes  of  military 
performance  such  as  the  value  of  a  Mach  3  speed  aircraft  or  of  the  fifteen- 
minute  warning  time  provided  by  a  radar  system. 

System:  A  system  is  the  sum  total  of  human  and  material  resources, 
including  the  procedures  required  to  coordinate  their  functioning,  employed 

III 

to  satisfy  a  designated  mission  or  objective.  For  Instance,  System  416L 
(SAGE)  basically  consists  •.  f  designated  types  and  quantities  of  buildings, 
equipment,  and  people  directed  tc  providing  warning  of  an  enemy  aircraft 
attack  on  the  Continental  United  States  and  Canada. 

Decision  Maker:  A  person  or  agency  responsible  for  choosing  among 
several  or  numerous  alternative  means  of  accomplishing  a  given  goal.  The 
term  t  clsion  maker,  as  used  here,  is  almost  synonymous  with  the  term 
manager.  The  term  "decision  maker**  is  preferred  to  the  term  ''manager*' 
because  the  term  "manager**  historically  connotes  administrative  responsibility 
that  may  or  nay  not  exist  In  certain  contemporary  decision  Ptkiss  situations. 
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1.3  The  Importance  of  Cost 


1.3.1  The  Kole  of  the  Cost  Estimate 

A  cott  eitLutt  is  properly  viewed  as  one  of  Che  tools  that  military 
planners  and  systems  designer 4  can  invoke  to  help  select  systems  that  will 
swxiad.se  the  effectiveness  of  the  military  forces.  This  view  contrasts 
with  the  position,  more  widely  held  five  years  ago  than  it  is  today,  that 
the  cost  estisiete  is  principally  a  constraint  or  club  wielded  by  comptrollers 
to  limit  the  effectiveness  of  the  military  force. *  (See  below) 

The  role  of  the  cost  estimate  in  helping,  rather  than  hindering,  the 
military  planner  to  maximise  the  effectiveness  of  his  forces  rests  upon 
a  series  of  self 'evident  and  generally  accepted  propositions.  These 
propositions  are  derived  from  classical  economic  principles  and  apply  with 
equal  force  in  any  decision  situation  whether  one  adopts  the  perspective 
of  a  private  family  seeking  to  spend  its  income  wisely,  a  corporation 
executive  trying  to  strengthen  the  total  competitive  position  of  his 
company,  a  university  president  trying  to  match  his  plans  and  programs  to 
his  resources,  or  a  military  planner  striving  to  maximise  the  effectiveness 
ot  his  military  forces 

1.3.2  Multiplicity  of  Coals 

The  first  proposition,  referenced  above,  is  that  men  and  organisations 
in  all  walks  of  life  have  a  multiplicity  of  goals,  missions  and  objectives 
that  they  desire  to  satisfy. 

1.3.3  Scarcity  of  lesources 

The  second  proposition  has  two  parts.  First,  resources  oust  be 

expended  --  costs  incurred  -*  to  carry  out  the  programs  drafted  to  meet 

the  multiple  objectives  referenced  above.  Second,  whatever  the  context. 

Footnotes  related  to  eich  chapter  %re  described  at  the  end  of  that  chapter, 
with  certain  significant  exceptions  which  are  incorporated  in  the  text. 
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usually  outstrips  che  total  supply  of  resources.  In  other  words,  there 
are  normally  unfilled  demands;  for  all  practical  purposes,  a  decision¬ 
maker  seldom  has  sufficient  resources  to  carry  out  fully  all  of  the  programs 
that  he  regards  as  legitimate  and  useful. 

1.3.4  Opportunity  Costs 

Since  considering  ail  missions  or  objectives  in  toto  the  demand  for 
resources  exceed  their  supply,  it  follows  that  every  dollar  or  unit  of 
resources  committed  to  one  use  means  one  less  dollar  or  unit  of  resources 
available  elsewhere.  In  other  words,  there  is  an  “opportunity  cost"  -- 
an  opportunity  lost  to  satisfy  some  other  legitimate  objective  elsewhere  -- 
associated  with  using  limited  supply,  multi-use  resources  to  satisfy  one 
want  or  objective  rather  than  another. 

1.3.5  Alternative  Means  To  An  End 

A  fourth  proposition  is  that  there  are  always  several  or  numerous 
different  ways  of  satis. ying  each  of  the  competing  goals  or  missions  that 
a  decision-mal.er  has.  This  is  as  true  whether  the  context  is  that  of  a 
private  family  planning  to  meet  its  require  ents  for  shelter,  transportation, 
or  higher  education  as  it  is  of  a  military  planner  seeking  to  provide  a 
capability  for  warning  against  an  enemy  attack  or  an  effective  counter¬ 
attack  capability. 

1.3.6  Different  Resource  acquirement s 

Different  system  alternatives  for  meeting  a  given  objective  provide 
different  efficiencies  (different  outputs  per  unit  input)  in  the  way  they 
use  available  resources.  Consequently,  the  costs  of  attaining  a  specified 
or  equivalent  standard  of  effectiveness  in  any  given  mission  area  varies 

(sometimes  greatly)  from  system  alternative  to  system  alternative. 
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Taking  as  generally  valid  each  of  the  preceding  propositions,  com¬ 
parative  costs  automatically  assume  importance  as  one  of  the  criteria 
that  a  decision-maker  interested  in  maximising  his  effectiveness  in 
several  mission  areas,  should  consider  in  selecting  among  system  alternatives. 
Since  every  dollar  or  unit  of  resources  coamitted  to  one  mission  means  one 
less  dollar  or  unit  of  resources,  and  hence  potentially  less  effectiveness, 
available  for  some  other  mission,  a  decision-maker  who  incurs  greater  costs 
than  necessary  in  order  to  attain  a  specified  or  equivalent  standard  of 
effectiveness  in  one  area,  vast  as  resources  and  in  so  doing  automatically 
reduces  the  effectiveness  of  his  total  forces. 

One  implication  of  this  "opportunity  cost"  approach  to  system  decision¬ 
making  is  a  rejection  of  the  notion  that  an  intrinsic  value  can  be  assigned 
to  achieving  any  performance  level  that  is  independent  of  the  costs  of 
achieving  that  goal-  Stated  affirmatively,  the  opportunity  cost  approach 
to  system  decision  making  contends  that  in  assessing  the  value  of  a 
proposed,  more  costly  increase  in  performance  capability  in  one  mission 
area,  one  must  consider  the  consequence*  of  a  degraded  performance  level 
in  some  other  mission  area  that  will  result  from  such  a  diversion  of 
resources.  To  illustrate,  it  is  impossible  to  decide  wisely  whether  we 
should  adopt  a  new  system  that  would  provide  a  ten  per  cent  increase  in 
our  offensive  striking  power  solely  by  considering  the  additional  damage 
such  an  increment  in  striking  power  would  enable  ua  to  inflict  upon  the 
enemy.  Whether  this  increased  striking  power--  whether  this  .'^creased 
capability  to  damage  the  enemy  •*  would  actually  enhance  our  total  military 
strength  compared  to  that  of  our  enemy  would  depend  upon  the  quantity  of 

rasourcas  required  (the  costa)  to  achieve  that  ten  per  cent  increase  in 
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striking  power  and  the  effect  such  diversion  of  resources  would  have  on  the 
level  of  performance  In  ocher  important  mission  areas.  When  resources  are 
scarce  —  as  they  always  sre  —  the  answer  to  the  above  question  would 
depend  upon  whether  the  opportunity  costs  of  the  ten  per  cent  increase  in 
striking  power  were  a  IX,  a  10X,  a  SOX  or  a  99X  relative  degradation  in 
some  other  vital  military  mission,  such  as  defensive  capability  or  some 
other  important  national  objective  such  as  economic  assistance  to 
undeveloped  countries. 

The  same  comparative  costs  trade-off  considerations,  of  course,  apply 
when  a  military  planner  or  system  designer  is  staking  intra-system  con¬ 
figuration  decisions  relative  to  the  amount  of  effectiveness  he  will  see 
in  the  realm  of  each  of  a  given  system's  performance  characteristics. 

1.3.8  Cost/gffectiveness  ta t lcmal e 

In  setting  forth  the  logic  of  the  "cost  as  a  decision  making  criterion", 
deliberate  care  has  been  taken  to  use  the  words  "specified"  or  "equivalent" 
level  of  effectiveness.  This  qualif ication  is  important  because  it  suggests 
another  important  point.  The  use  of  cost  as  one  of  the  decision  making 
criteria  does  not  necessarily  imply  a  preference  for  the  lowest  cost  system 
alternative.  (A  $2  pair  of  shoes  may  be  a  more  costly  means  of  providing 
for  one's  footwear  needs  than  is  a  $20  pair).  Cost  relative  to  effectiveness 
is  the  important  reference, and  the  lowest  cost  alternative  is  favored  only 
in  terms  of  a  specified  or  equivalent  level  of  effectiveness  for  the  various 
alternatives.  Mitch  and  HcKean  have  argued  persuasively  for  the  concurrent 
consideration  both  of  cost  and  elf ectiveness ,  for  a  cost/effectiveness 
approach,  in  making  system  analysis  decisions.  They  have  tried  to  make 
their  point  clea±  by  the  following  analogy: 
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Strategy  end  cost  ere  as  interdependent  as  the  front  and 
rear  sights  of  a  rifle  One  cannot  assign  relative 
weights  to  the  importance  of  the  positions  of  the  front 
and  rear  sights  It  does  not  make  sense  to  ask  the 
correct  position  of  the  rear  sight  except  in  relation 
to  the  front  sight  and  the  target.  Similarly  one 
cannot  economise  except  in  choosing  strategies  (or 
tactics  or  methods*  to  achieve  objectives.  The  job  of 
economising,  which  some  would  leave  to  the  budgeteers 
and  comptrollers,  cannot  be  distinguished  from  the 
whcle  task  of  making  military  decisions. ^ 

This  question  of  the  inextricable  relation  between  choosing 
objectives  and  compalative  costs  will  be  briefly  discussed  again  in 

l  ’ 

Chapter  10  when  the  use  of  the  cost  estimate  at  a  decision  making  tool  ia 

i 

resumed . 

In  summary,  the  universal  prevalence  of  resource  limitations,  the 
multiplicity  of  goals  and  missions,  the  ever  present  po&slbility  of  using 
alternative  means  or  systems  involving  different  resource  requirement*  to 
meet  each  specified  goal,  all  give  rise  to  an  opportunity  cost  in  using 
resources  one  way  vs  another  The  net  result  is  that  the  question  of 
comparative  cost  tikes  on  critical  importance  to  a  military  planner 

I  .  .... 

interested  in  maximising  the  effectiveness  of  his  total  forces. 

1.4  The  Importance  of  tellable  Costing 

1.4.1  The  Common  Sense  Argument 

Simple  logic  or  common  sense  would  dictate  that  if  comparative  cost 
ia  to  be  used  as  one  of  the  criteria  in  choosing  among  system  alternatives, 

I 

i 

it  la  important  that  these  costs  be  reliable,  in  other  words,  comparative 
cost  would  be  a  useful  and  valid  criterion  for  selecting  among  system 
alternatives  only  if  the  cost  estimates  measure  with  tolerable  accuracy 
the  actual  costs  they  are  intended  to  measure.  If  these  estimates  ara 
grossly  inaccurate,  they  will  serve  as  a  highly  misleading  decision  staking 


criterion 
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*  1-^.2  Tlie  Consequences  of  a  Costing  Error 

Untoward  consequence*  of  a  serious  error  in  a  cost  estimate  can  be 
.felt  in  the  case  either  of  a  serious  overestimate  or  underestimate.  A 
serious  overestimate  can  cause  a  decision  maker  to  forego  a  good  system 
because  it;  appears  to  be  too  expensive.  Or  an  overestimate  can  delay  other 
projects  by  erroneously  allocating  too  r  irv  resources  to  a  particular 
project. 

The  most  frequent  and  serious  consequences  of  an  error  in  costing 
occur,  however,  when  the  co.  ts  of  a  major  system  are  grossly  underestimated. 
This  is  true  because  historically  most  errors  have  been  underestimates."* 

The  consequence  of  a  serious  cosc  underestimate  is  normally  either  a 
retrenchment  in  the  affected  program  or  in  some  other  important  program. 
These  readjustments  in  programs  not  only  seriously  erode  the  planned 
effectiveness  of  the  total  military  force,  they  also  cause  a  serious  waste 
of  national  resources  and  frequently  entail  violent  and  prolonged  dis¬ 
locations  in  the  economies  of  large  regions  of  the  country. 

The  crucial  importance  of  minimising  such  adjustments  in  programs  and 
the  resulting  economic  dislocations  derives  from  the  tremendously  large 
resource  investment  the  nation  makes  in  military  am:  space  programs.  The 
military  and  space  industry  is  now  one  of  the  nation's  largest  industries, 
and  Defense  md  NASA  expenditures  constitute  roughly  ten  per  cent  of  the 
United  States  gross  national  product  and  exceed  the  gross  national  products 
of  all  but  a  handful  of  other  countries  in  the  world. 

In  certain  important  areas,  such  as  research  and  development,  the 
magnitude  of  military  programs  is  even  more  Impressive.  For  instance. 

United  States  annual  expenditures  for  all  types  of  medical  research,  public 
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end  private  combined,  approximate  91  billion  per  /e±r .  On  the  other  hand, 
research  and  development  expenditures  by  the  Department  of  Defense 
approximate  $7  billion  per  year.  Adding  the  BAD  expenditures  of  the 
National  Aeronautics  and  Spare  Administration  and  the  Atomic  Energy 
Commission  to  those  of  the  Department  of  Defense  increases  the  total 
federal  BAD  expenditures  for  national  security  purposes  to  approximately 
$13  billion. 

An  equally  impressive  picture  is  obtained  if  one  considers  individual 
systems.  A  landmark  was  reached  in  World  War  II  when  the  nation  undertook 
its  first  billion-dollar  system,  the  Manhattan  Project  to  develop  the 
atomic  bomb.  By  comparison,  in  1962  it  was  authoritatively  estimated  that 
the  Defense  Department  alone  had  twenty  systems  in  various  stages  of 

4 

development,  each  costing  $1  billion  or  more. 

Suammrising,  the  development  of  modern  military  and  space  systems  is 
perhaps  basically  the  largest,  most  comprehensive  series  of  ventures  that 
man  has  ever  undertaken  and  necessarily  requires  the  expenditure  of  huge 
quantities  of  resources.  However,  since  errors  in  estisuting  the  resource 

i! 

requirements  of  these  systema  can  have  far-reaching  repercussions  not  only 
on  the  effectiveness  of  our  total  military  posture  but  also  on  the  economic 
well  being  of  the  entire  country,  it  is  extremely  important  that  increasingly^ 
reliable  methods  for  estimating  the  costs  of  these  systems  be  developed. 

1.5  Why  It  Is  Difficult  To  Cost  A  Military  System 

1.5.1  A  Common  Misconception 

One  of  the  common  misconceptions  of  individuals  having  only  a  peripheral 

acquaintance  with  the  system  costing  field  is  the  notion  that  such  costing 

is  a  relatively  simple,  strelght-forward  numbers  game  requiring  a  basically 

unsophisticated  methodology.  Fortunately,  thla  judgment  has  been  tampered 
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in  recent  years  by  the  serious  difficulties  that  professionals  in  various 
disciplines  have  experienced  in  trying  to  accurately  estimate  an  advanced 
system' s  cost. 

Thera  are  many  reasons  why  it  is  difficult,  rather  than  easy,  to 
accurately  estimate  such  costs. 

1.5.2  Interdisciplinary  Knowledge 

One  reason  is  that  the  cost  analyst  must  be  conversant  in  several 
disciplines,  not  one.  This  can  be  explained  by  the  fact  that  historically 
most  serious  errors  in  system  cost  estimates  in  the  past  have  been  traced 
to  what  has  been  called  "configuration  uncertainty".  Stated  differently, 
swst  costing  errors  have  been  due  to  the  extreme  difficulty  of  anticipating 
in  the  advanced  planning  stage  of  a  system's  development  what  types  and 
quantities  of  resources  will  eventually  be  required  to  develop,  acquire, 
ard  operate  the  system.  If  the  cost  analyst  is  to  cope  with  configuration 
uncertainty,  it  is  not  sufficient  that  he  be  versed  in  accounting  techniques, 
cost  data  sources,  or  even  in  the  principles  of  economics. 

There  are  many  reasons  why  it  is  difficult  to  cope  with  configuration 
uncertainty.  One  is  that  the  specification  of  the  physical  unit  -*  the 
resource  definition  of  the  system  to  be  costed  --  is  a  derived  input  and 
this  derivation  is  a  function  of  such  elusive  considerations  as  the  nature 
of  the  enemy  threat  and  the  probable  impact  of  technological  progress. 

In  turn,  each  of  these  parameters  from  which  the  physical  unit 
calculation  is  derived  is  highly  unstable  and  very  difficult  to  predict. 
Taking  the  matter  of  technology,  for  instance,  the  rate  of  technological 
change  in  the  military  and  space  field  is  the  most  rapid  and  volatile  in 
our  economy. 
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Finally,  in  the  case  of  advanced  systems  costing  the  estimater  oust 
ba  projected  five  to  fifteen  years  into  the  ft'ure.  This  time-frame  in 
itself  present*-  a  prodigious  undertaking  if  one  compares  it  with  chat 
prevalent  in  other  disciplines  in  which  forecasting  is  practiced.  For 
instance,  econoaic  activity  forecasts,  political  forecasts,  weather  fore¬ 
casts-  and  forecasts  of  fashion  in  clothes  are  usually  restricted  to  a 
atatter  of  several  Months,  or  at  most,  a  year  or  two  ahead. 

1.5.3  Increasing  Complexity 

A  related  consideration  that  smkes  it  very  difficult  tc.  estimate  the 
costs  of  military  and  space  systoas  is  the  tremendous  and  increasing 
complexity  of  many  of  these  systems.  Coaplexity  as  defined  here  is  taken 
to  include  not  only  the  intricacy  of  the  basic  technology  of  these  systems 
but  also  the  aunifold  problems  in  keeping  abreast  of  a  rapidly  changing 
technology.  Various  authorities  have  assembled  objective  evidence  of  this 
coaqtlexity.  For  instance,  as  compared  to  military  systems  of  a  decade  or 
two  ago  or  as  compared  to  complex  contemporary  civilian  undertakings, 
many  military  and  space  systems  involve  tremendous  —  sometimes  geometric  -- 
increases  in; 

(1)  the  number  of  components  Involved.  For  instance.  Admiral  Kickover 
recently  testified  that  a  Polaris  submarine  contains  3,400 
separate  complicated  pieces  of  equipment  and  that  a  Polaris  sub¬ 
marine  must  carry  30,000  separate  kinds  of  spare  parts ? 

(2)  the  closeness  of  the  tolerances  and  reliabilities  with  which 
these  components  must  perform. 

(3)  the  number  of  different  functions  a  given  subsystem  must  perform. 

(4)  the  accuracy  with  which  these  subsystem  functions  must  be  performed. 
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(5)  th«  degree  of  Interdependency  involved  end  the  cloeenesa  of  the 
integration  required  asrnng  these  subsystems  and  coetponents. 

(6)  the  variety  and  severity  of  environmental  influences  that  must 
be  confronted  in  such  matters  as  temperature,  pressure,  altitude, 
humidity,  sonic  vibration,  electromagnetic  interference,  cosaiic 
particles,  etc. 

(7)  the  variety,  sophistication,  and  quantities  of  resources  required 
for  its  development  and  operation.  For  Instance,  modern  military- 
space  systeam  have  involved  a  hitherto  unheard  of  mobilisation 
both  in  depth  and  in  breadth  of  the  academic  and  industrial 
worlds.  For  instance,  new  sujor  professions  and  industries 

have  been  created  specifically  to  cope  with  the  tremendous 
technical  problems  associated  with  csveloping  and  operating  these 
systems.  Somewhat  illustrative  of  this  condition,  J.  F.  Atwood, 
President  of  North  American  Aviation  Co.,  recently  stated  that  today  the 
staff  of  his  company  has  degrees  In  175  different  college  majors 
whereas  twenty  years  ago  most  of  'he  company's  staff  was  trained 
in  one  of  four  basic  engineering  specialities.* 

Some  inkling  of  the  quantitative  impact  of  this  mobilisation  of 
scientific-technical  resources  can  be  gathered  from  an  examination  of  the 
number  of  engineering  sum-hours  required  to  develop  s  new  system.  In  this 
connection  whereas  msjor  systems  two  or  three  decades  sgo  may  have  required 
several  hundred- thousand  engineering  man-hours,  some  of  the  current  more 
advanced  systems  require  as  many  as  15,000,000  engineering  man-hours  to 
develop  the  system  from  design  to  initial  operating  capability. ^ 

1.5.4  Difficult  Data  Problems 

A  major  problem  in  securing  reliable  and  relevant  data  is  another 
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condition  that  makes  it  very  difficult  to  accurately  cost  a  military  or 
apace  ay stem  Flrat,  since  the  systems  approach  to  solitary  procurement 
is  relatively  new  —  e.g,  in  the  military  electronic  and  space  fields 
the  oldest  systems  were  introduced  less  than  a  decade  ago  --  there  is  a 
very  saail  historical  data  base  from  which  ts  project.  This  contrasts 
sharply  with  forecasting  economic  activity  or  population  growth  where  the 
historical  data  base  extends  back  for  decades  or,  in  some  cases,  for 
several  centuries. 

Second,  for  reasons  that  will  be  covered  in  Chapter  6,  even  this 
meager  data  base  consists  largely  of  heterogeneous  observations  having 
limited  comparability  with  each  other. 

Third,  because  the  rate  of  technological  development  is  so  rapid, 
cost  analysts,  to  a  much  greater  extent  than  is  necessary  in  most 
disciplines,  must  supplement  this  meager  and  dubious  historical  data  base 
with  expert  opinions ,  and  t'  e  problems  in  eliciting  and  evaluating  these 
pplnions  are  legion 

Fourth,  contributing  to  both  the  meagerness  and  the  dubious  quality 
of  both  the  historical  and  expertise  segments  of  the  data  base  is  the 
fact  that  such  of  the  most  relevant  data  are  closely  held  rather  than 
widely  disseminated.  Again,  there  are  many  reasons  for  this  situation: 
national  security  reasons.,  the  proprietary  character  of  many  industrial 
data,  end,  finally,  the  fact  that  the  possession  of  s  cost-estimating 
data  base  bestows  upon  the  holder  a  competitive  advantage  over  his  rivals. 

Fifth,  although  recent  changes  in  Department  of  Defense  regulations 

such  as  the  discontinuance  of  cost-plus -fixed- fee  type  contracts,  have 

promoted  greater  cost  realism,  inherent  biases  are  associated  with  much  of 

the  available  cost  data.  A  substantial  masher  of  all  cost  estimates  sre 
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developed  by  industrial  sources  to  support  a  particular  company's  system 
proposal  to  a  government  agency  or  by  a  lower  echelon  government  office 
to  win  approval  for  a  program  from  a  higher  level  government  office  in 
competition  with  other  prograau.  Considering  the  competitive  environment 
in  which  such  estimates  are  developed,  it  is  not  surprising  that  they 
frequently  lack  the  objectivity  of  a  United  States  Census  Bureau  population 
count. 


1.5.5  Difficult  Conceptual  Problems 

Highly  complicated  conceptual  problems  sometimes  make  il;  hard  to 

accurately  estimate  the  costs  of  a  military  system.  For  instance: 

a.  The  problem  in  defining  "system  cost"  parallels  the  problem  that 

economists  and  managering  accountants  have  had  for  years  in 

satisfactorily  defining  "profit"  from  either  a  social  or  a  broad 

corporate  perspective.  One  instance  of  this  problem  in  defining 

system  cost  occurs  in  trying  to  devise  suitable  ground-rules  for 

detecting  and  measuring  the  delayed  and  oblique  costs  associated 

|  with  inherited  assets,  shared  assets,  fixed  supply  assets,  salvage 

I  |  ( 

values,  and  spillovers  (see  Chapter  8). 


b.  There  is  a  great  problem  in  devising  suitable  criteria  for 

objectively  selecting  one  type  of  cost  classif ication  over  another 
(see  Chapter  4).  Or  similarly,  there  are  problems  in  defining 
specific  cost  elements  discretely  and  non-arbitrarlly.  For 
Instance,  in  evolutionary,  one-of-a-kind  command  and  control 
systems,  it  is  very  difficult  to  distinguish  between  certain 
Research  and  Development  and  Investment  Costs. 
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c.  It  is  very  difficult  to  establish  criteria  for  comparatively 
evaluating  and  weighting  heterogeneous  objective  and  subjective 
data  of  different  validities  and  relevancies  that  are  to  be  used 
as  inputs  to  a  future  estimate.  (See  Chapter  7.) 

1.5.6  Lack  of  Formalised  Methodology 

The  newness  of  the  field  and  the  consequent  lack  of  a  formalised 
methodology  is  a  final  reason  why  the  task  of  estimating  the  cost  of  a 
military  system  is  difficult.  The  cost  analyst  must,  to  such  a  large 
extent,  rely  on  "his  own  devices".  This  lack  of  a  formalised  methodology 
is  evidenced  in  many  ways.  No  text  book  has  ever  been  written  on  the 
subject  in  contrast  to  the  literally  hundreds  of  texts  that  have  been 
written  in  the  older  disciplines  such  as  economics,  engineering  or 
accounting  or  the  dosens  of  books  that  have  been  written  in  such  newer 
fields  as  operations  research.  In  fact,  except  for  the  pioneering  BAND 
literature,  there  is  almost  no  "public"  (generally  available)  literature 
on  the  subject.  There  is  no  journal  in  the  field.  As  far  as  the  writer 
knows,  no  civilian  university  gives  a  course  on  the  subject.  It  is 
interesting  that  even  the  "Economics  of  National  Security"  course  given 
by  the  Industrial  College  of  the  Armed  Forces  does  not  (1962)  discuss 
the  economics  of  costing  or  selecting  a  military  system.  Most  of  those 
working  in  the  field  were  originally  trained  in  a  wide  variety  of  other 
professional  disciplines  and  they  have  literally  learned  by  doing  insof  r 
as  military  system  costing  is  concerned.  There  is  one  exception.  During 
recent  years  BAND,  the  Air  Force  Institute  of  Technology,  and  Ohio  State 
University  have  trained  some  Air  Force  personnel  in  this  field. 
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Th«  importance  of  reliable  cost  estimating  to  the  military  decision 
maker  and  the  difficulties  associated  with  accomplishing  it  have  bean 
outlined  in  the  previous  sections.  This  section  will  set  forth  the  basic 
premis-  upon  vhich,  in  the  opinion  of  the  writer,  a  better  costing 
methodology  must  be  built. 

Simply  and  most  generally  stated,  the  path  to  progress  in  the  field 
of  costing  lies  in  more  extensive  and  intensive  application  of  what  is 
popularly  termed  the  "scientific  method".  In  this  sense,  basic  methodology 
in  system  costing  must  follow  the  example  set  by  every  other  field  of 
learning  for  the  last  several  centuries.  The  amazing  progress  that  has 
been  realized  in  other  fields  of  knowledge,  such  as  modern  medicine  and 
scientific  management  —  to  mention  two  that  touch  the  daily  lives  of 
everyone  --  can  be  traced  to  the  fact  that  the  scientific  method  has  been 
applied  increasingly  to  problems  in  these  areas. 

Although  the  scientific  method  has  many  characteristics,  its  most 
distinctive  quality  is  that  it  substitutes  objectively  verifiable  e\iden,u 
for  authority  as  a  criterion  of  validity.  Operationally  this  means  that 
the  cost  analyst  must  formalise  his  procedures  explicitly  so  that  his 
client  or  another  analyst  can  independently  replicate  and  verify  his  step* 
by-step  methodology  from  beginning  to  end. 

Alain  C.  Bnthoven  has  perhaps  best  detailed  the  characteristics  of 

this  approach  in  recommending  the  application  of  the  scientific  method  to 

system  analysis  problems  in  general: 

First,  the  method  of  science  is  an  open,  explicit, 
verifiable,  self-correcting  process.  It  combines  logic 
and  empirical  evidence.  The  method  and  tradition  of 
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science  require  thet  scientific  results  be  openly  arrived 
at  in  such  a  way  that  any  other  scientist  can  retrace 
the  same  steps  and  get  the  same  result.  Applying  this  to 
weapon  systems  and  to  strategy  would  require  that  all 
calculations,  assumptions,  empirical  data,  and  judgments 
be  described  in  the  analysis  in  such  a  way  that  they  can 
be  subjected  to  checking,  testing,  criticism,  debate, 
discussion,  and  possible  refutation.** 

The  reason  why  this  method  of  science  has  historically  been  so 
successful  in  solving  problems  in  many  fields  has  been  generalised  by 
Jay  Forrester  as  follows: 

The  rapid  strides  of  professional  progress  come  when  the 
structure  and  principles  that  integrate  individual 
experiences  can  be  identified  and  taught  explicitly 
rather  than  by  indirection  and  diffusion.  The  student 
can  then  inherit  an  intellectual  legacy  from  the  past 
and  build  his  own  experiences  upward  from  that  level, 
rather  than  having  to  start  over  again  at  the  point  where 
his  predecessors  began. * 


Applying  Bnthoven's  and  Forrester's  reasoning  to  the  field  of  system 
costing,  the  scientific  method  should  help  the  analyst  to  achieve  greater 
success  in  accurately  estimating  the  costs  of  a  military  system  in  two 
specific  ways.  One  is  that  if  an  analyst  disciplines  himself  to  reach 
and  support  his  cost  opinions  in  a  manner  such  that  his  methodology  can 
be  independently  replicated  by  other  observers,  he  is  more  likely  to 
organise  his  data  and  conclusions  in  an  Internally  consistent  pattern. 
Second,  and  even  more  important,  the  opportunity  for  feed-back,  which  is 
essential  to  scientific  progress  in  any  field,  is  critically  contingent 
upon  relatively  explicit,  formalised  procedures.  If  this  analyst  end  other 
observers  are  to  profit  both  by  his  mistakes  and  good  insights,  it  must 
be  clear  as  to  how  he  reached  his  cost  conclusions  and  why. 

One  of  the  probl»s  with  much  of  system  cost  analysis  in  the  past 
has  been  that  so  much  of  the  modus  operand!  has  been  unspecified  even 
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when  overtures  at  formal  documentation  have  been  attempted.  Under  such 
circumstances  when  the  analyst's  estimating  procedures  are  predominantly 
labile it,  ha  finds  it  difficult  to  axplain,  even  an  coat  facto,  tha  reasons 
for  his  important  decisions.  He  cannot  determine  why  he  went  wrong  because 
he  had  never  thought  out  very  carefully  why  he  originally  selected  the 
particular  cost  estimating  method  that  he  used. 

It  saist,  of  course,  be  realised  that  the  terms  objective  methodology 
va.  subjective  methodology  reference  an  idealised  dichotomy.  In  practice 
no  methodology  is  ever  likely  to  be  tdiolly  objective  or  subjective. 

However,  the  terms  are  useful  in  distinguishing  the  direction  in  which 
we  are  to  move.  In  this  sense  the  goal  should  be  to  impart  mors  science 
and  system  to  cost  estimating  and  analysis  rather  than  len,  to  make  the 
undertaking  more  of  a  science  and  less  of  an  art. 

One  final  note.  The  desire  to  make  the  methodology  of  system  cost 
analysis  more  scientific  does  not  scan  that  reliance  on  judgment  and 
expert  opinion  trill  be  abandoned.  Quite  the  contrary,  in  Chapter  7  it 
will  be  argued  that  increasing  provision  must  be  msde  to  incorporate 
expert  opinions  as  data  inputs  into  the  estimating  procedure  because  such 
opinions  are  often  more  relevant  than  available  historical  data  to  a  new 
system  being  coated.  Hhat  la  does  mean  ia  that  judgment  must  be  injected 
into  the  estimating,  analysis,  and  decision  processes  in  an  axpllcit  and 
deliberate  fashion  and  not  used  indiscriminately  as  a  cloak  to  camoflauge 
soft  areas  in  data  or  evaluation. 

1.6.2  Stress  on  General  Method 

It  ia  a  truism  to  state  that  no  two  systems  are  alike  in  configuration 
and  operation  or  to  stats  that  significant  differences  also  exist  among 
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certain  broad  classes  of  systea*.  For  instance,  certain  electronic 
(commend  and  control)  systeas  differ  fro*  weapon  systeas  in  that  the  former 
tend  to  be  one  unit  systeas  (like  a  headquarters  coemend  post),  rather  than 
many  units  systeas  (hundreds  of  B~52  airplanes).  Cotsaand  and  control 
systeas  also  tend  to  evolve  froa  former  systeas  rather  than  to  aake  a 
complete  departure  froa  former  systeas  as  new  weapon  systeas  sometimes  do. 
Th- se  design  and  functional  differences  also  have  certain  implications  for 
costing  methodology  such  as  the  selection  of  criteria  for  distinguishing 
development  froa  investment  costs. 

However,  in  aost  major  respects  comparable  problems  are  confronted 
and  coaparable  approaches  should  be  taken  whether  the  project  is  to  cost 
one  type  of  electronic  system  or  another,  an  electronic  system  or  a  weapon 
system;  an  Air  Force  systea  or  an  Aray.  Navy  or  NASA  systea;  a  military 
systea  or  a  large  unique  civilian  project  such  as  the  building  of  an  finpire 
State  Building,  a  New  York  World's  Fair,  a  "Cleopatra" -type  motion  picture, 
or  a  aajor  new  industry  In  equatorial  Africa. 

Froa  the  point  of  developing  a  systematized  methodology,  this  com¬ 
parability  of  methodological  problems  and  tasks  has  a  real  advantage  in 
the  possibilities  it  poses  for  a  pooling  of  knowledge.  Techniques  that 
improve  cost  estimating  and  analysis  methods  for  one  type  systea  will 
almost,  per  force,  improve  the  state  of  the  art  for  estimating  and  analyzing 
coata  for  other  type  systesui. 

The  methodological  analogy  extends  even  further.  As  will  be  apparent 
froa  the  discussion  of  later  chapters,  the  methodological  problems  (both  con 
ccptual  and  empirical)  that  plague  the  systea  cost  analyst  are  very  similar 
to  those  that  confront  specialists  in  other  disciplines  such  as  economics 
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In  general,  management  science,  sociology,  psychology,  operations  research, 
Managerial  accounting,  and  even  philosophy.  Once  again,  this  cooaonallty 
of  problems  offer?  a  fruitful  opportunity  for  benefit  from  a  study  of  the 
Methodologies  of  kindred  disciplines. 

Proceeding  froa  the  premises  set  forth  above,  this  paper  will  seek 
to  Identify  and  auike  explicit  the  separate  but  related  tasks  that  an 
analyst  has  to  perform  and  the  types  of  decisions  he  has  to  make  in  costing 
any  military  or  space  system.  In  the  process  this  paper  will  seek  to 
pinpoint  methodological  pay-off  ‘.asks,  i.e.,  tasks  whose  effective 
accomplishment  have  major  import  in  deriving  an  accurate  and  useful  system 
cost  estimate.  Illustrative  of  these  tasks  are  the  following: 

a.  What  should  an  analyst  learn  about  the  system  he  is  to  cost  and 
his  client's  intended  use  of  the  estimate  before  he  begins  costing? 

b.  What  criteria  should  he  use  to  determine  the  allocation  of  his 
limited  time  to  different  phases  of  the  costing  effort? 

c.  What  types  of  activities  and  resources  does  he  cost,  and  in  what 
detail? 

d.  What  types  of  data  does  he  admit  as  inputs  in  order  to  cost  the 
activities  and  resources  identified  in  c.  above,  and  where  does 
he  obtain  these  data? 

e.  How  does  he  evaluate  and  synthesise  his  data  inputs  to  arrive  at 
his  element -by -element  coat  estimates? 

f.  Bow  does  he  structure  his  separate  element  costs  into  a  total 
system  cost  and  how  does  he  present  this  estimate  in  the  most 
meaningful  and  u: iful  format  to  his  client? 


1.7  gueamry 


The  purpose  of  this  document  is  to  delineate  the  aujor  steps  involved 
in  costing  a  military  system. 

tihen  properly  used,  a  cost  estimate  can  assist  the  military  planner 
in  selecting  his  systems  so  as  to  maximise  the  total  effectiveness  of  his 
military  forces. 

Cost  is  Important  as  one  of  the  decision-making  criteria  to  the 
military  planner  because  total  resources  are  in  short  supply;  hence  an 
overcommitment  or  an  unvise  commitment  of  resources  in  one  program 
automatically  reduces  resources  available  to  other  programs  vithbut 
commensurate  benefit  and  thereby  weakens  the  total  military  strength  of 
the  nation. 

It  is  important  that  military  system  costs  be  estimated  reliably 
because,  if  cost  is  used  as  a  decision  criterion,  a  wrong  cost  estimate 
can  lead  to  a  wrong  system  decision  with  consequent  reduced  total  military 
effectiveness  and  severe  economic  dislocations. 

is  difficult  to  estimate  the  costs  of  a  military  system  accurately 
because  the  accuracy  of  these  estimates  depend  upon  correctly  determining 
the  highly  unpredictable  system  configuration,  because  these  systems  are 
becoming  Increasingly  complex,  because  necessary  data  are  sparse  and  of 
questionable  quality,  because  difficult  conceptual  problems  must  often 
be  resolved,  and  because  the  lack  of  a  formalised  methodology  obliges  the 
estimator  to  devise  many  of  his  procedures  on  an  ad  hoc  basis. 

Despite  the  obvious  design  and  functional  differences  among  systems, 
there  are  certain  basic  tasks  involved  in  costing  all  systems.  This 
document  aims  to  identify  these  tasks  and  to  provide  some  inkling  as  to 
how  they  may  be  performed. 
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HcWsmara  has,  of  course,  reorganised  the  sunagemeat  of  the  entire 
national  defense  program  around  this  concept. 
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reasons  or  are  restricted  from  public  release  for  proprietary  reasons. 
However,  some  unclassified  data  are  to  be  found  in  an  otherwise 
classified  Air  Force  report:  USAF  61  WWZ-188 ,  "System  Acquisition  - 
Cost  and  Control,"  pp.  10-23.  Another  brief,  general,  unclassified 
discussion  of  this  subject  awy  be  found  in  C.  B.  Hurst,  "Why  Systems 
Engineering,"  Ordinance  Magasine.  Sept ember -October  1962,  pp.  175-176. 
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Jay  Forrester,  Industrial  Dynamics.  (MIT  Press  and  John  Wiley  and  Sons,  18 
1961),  p.  2. 
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CHAPTER  2 


ASCERTAINING  THE  PURPOSE  OP  THE  ESTIMATE 

2.1  A  Kit  Of  Tooli 

Tha  cost  analyst's  first  responsibility  is  to  ascertain  as  specifically 
aa  possible  bow  bis  client  intends  to  use  the  cost  estlaate  he  has  requested. 
This  la  important  because  the  purpose  of  the  estiaate  can  importantly 
Influence  the  methods  used  to  estiswte  a  system* s  cost.  In  effect,  this 
is  to  say  that  systea  cost  acthodology  consists  of  a  kit  of  tools,  rather 
than  a  single  standard  set  of  procedures,  and  that  this  methodoln&y  tu¬ 
be  varied  selectively  to  fit  the  intended  application. 

Before  examining  the  specific  amnner  in  which  the  intended  application 
of  a  cost  estiaate  can  influence  the  aethods  used  to  derive  the  estimate, 
it  is  pertinent  to  discuss  briefly  In  a  general  way  the  terms  "client”  and 
"applications". 

2.2  Costing  Applications 

Relative  to  applications,  cost  estimates  are  desired  for  aany  purposes. 
There  is,  however,  no  exhaustive,  mutually  exclusive,  well-defined, 
authoritative,  centrally  available  cataloguing  of  the  types  of  such  applications 
Some  of  the  applications  referenced  in  the  literature  are:  programming, 
funding,  budgeting,  contracting,  pricing,  financial  management,  forecasting, 
coaqparative  analysis,  system  design  and  analysis,  etc.  Among  the  uses  of 
cost  estimates  on  the  above  lie:  and  among  the  uses  not  identified  above, 
there  is  considerable  overlap.  In  this  area,  as  in  many  other  fields, 
different  terms  have  similar  meanings  to  different  people. 

However,  from  the  point  of  view  of  methodology,  there  are  basically 

two  types  of  estimates,  although  in  practice  there  are  many  variants  of 
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these  two  typ««.  The  first  type  of  estimate  ii  a  planning  type  estimate 
and  la  in  tend  ad  as  an  input  to  a  system  analysis  study.  This  type  of 
estimate  la  intended  aa  a  tool  to  help  the  decision  naker  teach  a  coat/ 
effectiveness  choice  among  alternative  systems  for  satisfying  a  specified 
requirement.  The  second  type  of  estimate  is  a  funding  type  estimate  that 
aiau  to  provide  a  basis  for  soliciting  funds  to  implement  a  specific  design 
or  acquisition  program. 

2.3  Cost  Clients 

Relative  to  clients,  many  organisations  and  many  echelons  of  authority 
within  given  organisations  seek  cost  estimates.  Usually  the  cost  estimate 
is  one  segaMnt  of  a  broader  system  study  or  program  proposal  and,  in  effect, 
the  cost  analyst  normally  has  several  levels  of  clients  for  a  given 
estimate.  Since  the  study  or  proposal  of  which  the  cost  estimate  is  an 
integral  part  usually  must  be  approved  by  several  or  many  echelons  of 
authority  before  it  is  acted  upon,  the  cost  analyst  actually  has  both 
lamedlate  and  ultimate  clients  for  a  given  estimate. 

Organizationally  speaking,  many  agencies,  public  and  private,  are 

engaged  in  making  and  reviewing  military  system  cost  estimates.  On  the 

highest  level  of  the  government,  the  Bureau  of  the  Budget,  the  Congress, 

and  in  some  cases  the  President, himself .review  Department  of  Defense 

programs  and  proposed  expenditures  and  weigh  the  advantages  of  specific 

Defense  Department  programs  vs  other  type  programs  as  a  means  of  promoting 

the  national  welfare.  On  a  top  military  level  the  Department  of  Defense 

reviews  and  monitors  the  estimates  prepared  by  the  three  Services.  Vi  thin 

each  Service  higher  echelons  review  and  monitor  the  estimates  generated 

at  lower  echelons.  For  instance,  AFSC  and  Headquarters  USAF  approve  the 

estimates  submitted  by  each  of  the  AFSC  Divisions,  e.g.,(E3D,  ASD,  BSD,  6  SSD) 
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and  prepared  by  various  organisational  units  within  these  Divisions. 
Additionally,  industrial  contractor  normally  include  cost  estimates  with 
the  various  system  proposals,  both  solicited  and  unsolicited,  that  they 
submit  to  the  military  services.  Finally,  technical  support  organisations 
use  coat  estimates  in  their  system  analysis  work  in  ascertaining  the 
coat/effectiveness  trade-offs  of  various  system  alternatives. 

f 

Since  the  way  that  a  cost  estisuite  is  used  can  vary  as  it  is  trans¬ 
acted  through  different  channels,  a  problem  confronting  the  cost  analyst 
is  how  to  formulate  and  present  his  findings  so  that  they  will  be  properly 
interpreted  by  his  immediate,  intermediate,  and  ultimate  clients.  Another 
problem  la  that  the  cost  analyst  does  not  always  know  for  sure  who  his 
ultimate  clients  are  or  specifically  how  they  will  use  his  findings. 
Chapter  9, dealing  with  presentation  and  documentation, will  offer  some 
guidance  on  these  amtters.  Additionally,  the  balance  of  this  chapter  will 
be  devoted  to  explaining  some  of  the  methodological  differences  that  apply 
when  making  estimates  for  the  several  different  purposes. 

2.4  Costing  Concepts 

Among  the  most  important  differences  between  a  planning  and  funding 
type  cost  estimate  is  that  they  are  based  on  importantly  different  concepts 
of  cost.  The  funding  type  estimate  measures  the  amount  of  money,  the 
number  of  dollars,  that  will  be  required  to  implement  a  particular  program 
or  a  system.  It  represents  what  methodologists  call  a  "cash  flow"  concept. 

On  the  other  hand,  planning  type  cost  estimates  are  based  on  what 

methodologists  call  a  "value  flow"  concept.  Several  writers  also  have 

described  this  concept  as  an  "alternative  value  cost".  Thus,  G.  H. 

Fisher  has  stated  that  "...  the  cost  of  obtaining  a  certain  objective  at 
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Bame  point  in  time  is  Matured  by  the  resources  that  sre  not  available 

for  use  in  attaining  alternative  objectives  because  these  resources  are 

c omitted  to  the  chosen  objective-"1  Similarly,  V.  A.  liskanen,  Jr.  has 

stated  that  "the  cost  of  a  weapon  system  is  the  measure  of  the  resources 

2 

committed  to  that  system  at  their  relative  value  in  other  uses."  la 
practice  what  this  frequently  means  is  that  a  planning  type  estimate, in 

addition  to  relevant  money  costs, will  also  include  cost  generated  by  a 

| 

program  that  are  not  directly  or  lamed lately  reflected  in  money  costs. 

I  | 

For  example,  this  concept  of  cost  would  include  the  "opportunity  costs"  of 
u|ing  a  valuable,  multi-use  inherited  asset  in  one  employment  rather  than 

another.  It  would  also  take  account  of  the  "inputed  cost"  represented  by 

| 

a  reduced  effectiveness  in  an  original  system  A  that  may  result  from  the 
introduction  of  a  new  system  B  in  which  B  shares  with  A  the  services  of 
certain  joint-use  type  assets.  Chapter  8  will  discuss  in  more  detail  the 
problems  involved  in  handling  such  opportunity  and  inputed  costs. 

2.sf  Scope  Of  Activities  To  Be  Costed 

One  of  the  valuable  contributions  of  BUD  costing  amthodology  has 
been  the  total  activity  concept.  This  concept  states  that  all  of  a  system's 

i  1  ; 

costs  both  direct  and  indirect  from  "the  cradle  to  the  grave",  firm  initial 
concept  to  final  termination,  should  be  taken  into  consideration  in  pre¬ 
paring  an  estimate.  Practically  all  system  cost  analysts  now  subscribe  to 
this  principle  and  the  Department  of  Defense  Programing  procedures 
prescribe  that  the  costs  of  all  program  elements  (systems)  are  to  include 
and  itemise  the  BDT&B  (Kesesrch,  Development,  Test,  and  Evaluation) ,  Initial 
Investment,  and  Operations  Costs  covering  a  five-year  period.  Although 
this  total  activity  principle  in  its  general  statement  is  quite  valid,  it 

is  important  to  note  how  the  purpose  of  the  estimate  may  sometimes  justify 
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including  something  less  then  the  HtotalM  costs  of  s  system  in  an  estimate. 

It  was  mentioned  in  2.4  above  that  funding  estimates  are  cash  flow 
estimates  and  by  definition  exclude  opportunity,  input ed ,  and  other  non¬ 
cash  costs.  In  this  sense  a  funding  estimate  would  be  narrower  in  scope 
than  a  planning  type  estimate  covering  the  same  system  alternative. 

On  the  other  hand,  a  planning  type  estimate  may  sometimes  properly 
omit  whole  areas  of  cost  that  would  have  to  be  included  in  a  funding 
estimate.  Since  the  objective  in  a  planning  estimate  is  to  select  the 
preferred  among  several  system  alternatives,  certain  major  and  minor  areas 
of  cost  may  be  identical  for  each  of  the  alternatives.  Since  these  cost 
areas  have  a  neutral  impact,  they  may  for  purposes  of  intra-systems 
analysis  be  omitted  without  violating  the  purpose  of  the  estimate  —  to 
make  a  choice  among  alternatives.  Especially,  when  the  problem  is  to 
optimise  some  detail  design  within  the  context  of  a  particular  subsystem, 
the  analysis  can  profitably  stress  the  elements  for  which  the  cost  impact 
differs  from  alternative  to  alternative.  However,  it  would  be  a  serious 
mistake  to  use  this  partial  intra-system,  planning  type  estimate  for 
funding  purposes.  It  would  also  be  a  mistake  to  submit  this  partial,  intra 
ay st cm,  planning  type  estimate  to  higher  headquarters  for  a  planning  type, 
cost /effectiveness  comparison  with  other  system  proposals  submitted  by 
other  echelons. 

Thus,  partial-type,  narrow  scope  funding  estimates  are  likely  to  omit 
certain  costs  properly  included  in  a  planning  type  estimate  whereas  partial 
type,  narrow  scope  planning  type  estimates  are  likely  to  omit  costs 
properly  included  in  a  funding  estimate. 


As  s  general  principle,  it  is  desirable  to  minimise  error  in  any  type 

* 

estinste  since  such  errors  almost  always  necessitate  some  revisions  in 
approved  program.  However,  the  client's  intended  use  of  the  cost  estinste 
css  influence  how  important  it  is  to  be  precise  in  deriving  the  total  cost 
estinste  or  in  eat  ins ting  particular  cost  elaamnts. 

Frequently,  it  has  been  stated  that  a  cost  estinste  oriented  to 
support  a  funding  request  requires  greater  precision  than  one  oriented 
toward  asking  an  advanced  planning  choice  snong  several  systasi  alternatives. 
The  prlnsry  rationale  for  this  s  tat  eaten  t  is  that  the  lowed  late  consequences 
of  an  error,  especially  an  underestimate,  are  ouch  greater  in  the  case  of 
s  funding  estiawte.  A  serious  underestimate  in  a  funding  estimate  can 
cause  a  relatively  early  crisis  in  the  affected  program  and  lead  to  a 
cancellation  or  serious  retrenchment  either  in  that  program, or  in  other 
program  if  funds  are  diverted  from  them  to  make  up  the  shortage  in  the 
referenced  program.  As  indicated  in  Chapter  1,  this  condition  not  only 

l!i 

reacts  unfavorably  on  the  nation  s  Isnediate  military  posture,  but  also 

I 

vitally  affects  the  welfare  of  swjor  industries ,  cowaunities,  and  thousands 
of  individual  citisena. 

■otmlly,  an  error  of  equal  magnitude  in  an  estimate  calculated  solely 
to  facilitate  a  planning  choice  aoumg  several  alternatives  will  have  less 
serious  repercussions.  When  die  nature  of  the  error  is  such  that  it  affects 
each  of  the  alternatives  similarly,  the  error  will  not  affect  the  relative 
preference  ranking  of  the  alternatives  That  is,  if  the  decision  at 
la  to  smke  a  definite  choice  among  several  specified  alternatives,  an 
underestimate  of,  say,  $10,000,000  in  the  KDT&E  costs  of  each  of  the 

alternatives  would  not  swing  the  choice  from  one  alternative  Co  another. 
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It  sight,  of  course,  affect  the  preference  ranking  of  these  alternatives 
relative  to  other  alternatives  not  subject  to  this  error. 

Moreover,  the  indirect  consequences  of  an  error  in  planning-type 
eetiBetes  are  normally  less  serious  than  in  funding -or ten ted  estimates. 

Since  planning-type  estimates  noraelly  gn  through  several  stages  of  review 
and  reconsideration  before  heavy  ccanitaents  to  purchase  equipment  and 
facilities  are  Bade,  an  initial  decision  favoring  a  system  can  be  revoked 
with  fewer  reverberations  throughout  both  the  military  and  civilian 
economies.  7or  instance,  if  later  information  reveals  an  equivalent  under¬ 
estimate  of  $10,000,000  in  the  cost  of  each  of  several  planning-stage 
alternatives,  still  other  less  costly  alternatives  ran  be  developed  and 
considered.  Including  the  possibility  to  undertake  no  new  system  in  that 
particular  mission  area. 

Finally,  in  the  case  of  funding  type  estimates  administrative-legal- 
political  constraints  may  dictate  that  the  analyst  seek  greater  precision 
in  certain  cost  elements  than  in  others.  Congress  authorizes  funds  to 
the  military  services  by  certain  classifications  and  sometimes  some  types 
of  funds  will  be  in  tighter  supply  than  others.  In  such  circumstances 

the  consequences  of  a  cost  prror  (an  underest imate)  in  a  tight -money  supply 

\  \ 

category  can  he  sore  serious  ^han  it  would  in  other  cost  elements  of  equal 
mngnitude.  One  practical  problem  in  taking  account  of  this  condition  is 
that  the  cost  analyst  is  often  poorly  informed  relative  to  these  differential 
funding  constraints. 

2.7  Consistency 

2.7.1  General 

The  purpose  of  die  estimate  also  influences  the  extent  to  which  the 


cost  Analyst  must  be  concerned  with  "consistency'’  in  his  methodology. 


Of  course,  considering  consistency  in  a  generic  seise,  i.e.,  "a  uniformity 
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of  i»r.ict Ice"  and  "a  Ii.nmmy  of  parts,"  both  funding  and  planning  estimates 
are  concerned  with  consistency.  Consistency  in  this  basic  sense  can  be 
taken  to  scan: 

a.  it  is  desirable  to  define  the  elements  of  a  cost  estimate  in  a 
discrete  and  Mutually  exclusive  Manner,  l.e.  it  is  nomelly  not 
desirable  to  include  Maintenance  labor  under  "personnel  costs" 
for  one  subsysteM  and  under  "equipment  Maintenance"  costs  for 
another  subsystem. 

b.  it  is  desirable  in  any  kind  of  a  cost  estimate  to  be  consistent 
in  the  estimating  relationships  used  to  calculate  like  items  of 
costs,  such  as  Military  Manpower,  from  one  subsystem  to  another. 

c.  it  is  desirable  to  be  consistent  in  the  sense  of  following 
prescribed  regulations  or  established  practice,  such  es  the 
procedures  and  ground  rules  followed  in  costing  intermediate 
support  or  logistics  services,  as  one  proceeds  from  one  costing 
project  to  another. 

d.  it  is  normally  desirable  to  be  consistent  or  uniform  in  bookkeeping 
p.^cedures,  such  as  in  rounding  off  decimal  places,  for  the  cost 
estimates  of  different  elements  within  a  given  system  estimate. 

Consistency  in  all  of  these  senses  apply  alike  to  both  planning  and 
funding  type  estimates. 

However,  planning  estimates  more  so  than  funding  estimates  are 
concerned  with  inter-system  consistency  in  the  sense  of  freedom  from  bias. 
This  arises  from  the  fact  that  planning  estimates  are  an  input  to  a 
comparative  study  of  different  system  alternatives  for  meeting  a  given 
performance  requirement,  and  there  are  numerous  subtle  ways  in  which  such 
comparisons  can  be  prejudiced. 
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The  important  crite.on  in  avoiding  bias  in  comparative  analysis  is 
to  strive  for  consistency  of  impact  on  total  system  cost  rather  than 
merely  consistency  of  procedure.  This  distinction  is  important  because 
consistency  (uniformity)  of  procedure  can  sometimes  lead  to  inconsistency 
in  impact  in  the  following  ways. 

2.7.2  Excluded  Costs 

It  sass  mentioned  in  Section  2.5  that  it  la  sometimes  legitimate  in 
planning  type  estimates  to  make  comparative,  partial  cost  estimates,  to 
exclude  certain  Identical  neutral  elements  from  all  system  alternatives 
being  compared.  However,  to  do  so  legitimately,  it  is  necessary  to 
determine  that  the  excluded  itea(s)  has  (have)  eoual  cost  impact  on  all 
alternatives.  For  instance.  It  would  not  be  legitimate  to  exclude  all 
personnel  costa  from  each  of  two  system  alternatives  if  one  system  were  a 
manual  system  using  many  personnel  and  the  other  an  automated  system 
using  few  personnel. 

2.7.3  Hon-Monetary  Costs 

Similarity,  in  the  treatment  of  indirect,  non~monetary  costs, it  would 
not  be  legitimate  to  cost  all  inherited  assets  as  free  to  all  system 
alternatives  if  some  alternatives  would  use  few  or  no  inherited  assets  and 
other  alternatives  would  draw  heavily  on  valuable,  multi-use  inherited 

assets. 

2.7.4  Element  Accuracy 

It  was  stated  in  Section  2.6  that  precision  and  accuracy  are  less 

important  to  a  planning  estimate  than  to  a  funding  estimate.  While  true, 

thla  proposition  must  be  qualified  in  terms  of  a  consistency  of  impact 

criterion.  This  applies,  for  instance,  to  the  accuracy  of  the  cost 

estimating  relationships  used  to  calculate  a  cost  element.  If  one  system 
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alternative  involve*  very  little  oversea*  travel,  end  a  second  alternative 
involves  considerable  overseas  travel,  it  would  certainly  not  be  Lmaterial 
whether  we  used  a  correct  factor  of  $700  per  wan  transported  or  an  Incorrect 
factor  of  $70  or  $7,000  per  mo  transported. 

2.7.5  Procedural  Consistency 

Sometimes  on  analyst  aust  resort  to  different  methods  for  calculating 
a  certain  cost  elesutnt  in  different  system  alternatives.  This  may  sometimes 
occur  in  advanced  planning  studies  when  relatively  incomplete  information 
is  available  on  the  alternative  performance  and  design  characteristics. 

Or  sometimes  the  analyst  may  be  asked  to  review  for  consistency  and  general 
validity  the  cost  estimates  covering  system  alternatives  prepared  by 
several  different  organizations  that  employed  different  methods  for 
calculating  a  given  type  of  cost.  Thus,  (1)  in  one  case  computer  pro¬ 
gramming  costs  may  have  been  calculated  as  $X  per  instruction  for  the 
program  being  established,  (2)  in  a  second  case  as  YX  of  the  data  processing 
mission  equipment  costs,  (3)  in  a  third  case  as  $Z  per  programmer  employed 
per  year.  The  consistency  criterion  would  require  that  the  analyst 
determine  that  differences  or  similarities  in  the  final  dollar  estimates 
of  computer  programing  costs  in  the  three  instsnees  could  be  traced  to 
differences  in  the  actual  resource  requirements  for  computer  programming 
and  not  to  peculiarities  of  the  different  procedures  used  to  estimate  the 
cost  in  each  instance. 

2.8  Sophistication  of  Technique 

The  purpose  for  which  the  estimate  is  to  be  used  and  the  attendant 
constraints  that  impinge  on  the  analyst  nay  also  influence  the  relative 
sophistication  in  cost  methodology  that  is  appropriate.  Two  examples  will 


be  cited. 
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2.6.1  Manual  vy.  Automated  Methods 


The  purpose  end  type  of  estimate  required  may  influence  the  choice 

| 

of  manual  va.  automated  methods  for  processing  the  cost  Inputs,  performing 
the  matheaa t ical  computations,  and  printing  out  the  results  of  the  study. 
When  the  client  requires  a  cost  comparison  of  numerous  alternatives,  such 
••  In  a  planning  type,  cost  sensitiviuy  study,  certain  typrs  of  computer 
oriented  cost  models  (BAND,  MITRE,  Research  Analysis  Corporation)  can  greatly 
reduce  the  time  required  to  make  the  estimate.  This  is  most  likely  to  be 
true  vhen  the  cost  results  are  to  be  reported  in  terms  of  a  relatively 

I 

detailed,  standardized  set  of  cost  categories  and  elements. 

(hi  the  other  hand,  when  only  a  single  configuration  is  to  be  costed  — 
aa  la  normally  the  case  with  a  funding  estimate  —  a  manual  costing  may  be 
faster.  This  is  most  likely  to  be  true  vhen  the  totsl  costs  of  the  single 
Configuration  sre  to  be  subdivided  into  a  relatively  small  number  of  cost 


el 


ta,  and  this  cost  structure  differs  substantially  from  the  standardized 
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cost  structure  reflected  in  the  cost  model 
2.8.2  (.Handling  Uncertainty 

Another  vey  in  which  the  client's  purpose  can  Influence  the  relative 
sophistication  of  costing  technique  employed  concerns  the  way  uncertainty 

I 

Is  handled.  Many  times  the  client  desires  the  cost  results  expressed  as  a 
single-valued  estimate.  For  instance,  funding  requests  to  Congress  must 
ha  stated  as  a  specific  sum  of  money.  In  such  cases  uncertainty  is  either 
Ignored  or  is  handled  simply,  e.g.,  an  allowance  for  contingencies  may  be 
Included  as  one  of  the  cost  elements  that  comprise  the  total  cost  estimate. 

i 

On  the  other  hand,  vhen  the  dent's  purpose  is  to  make  a  choice 
g  several  alternatives,  he  may  wish  to  give  more  detailed  consideration 


to  tha  various  degrees  of  uncertainty  surrounding  the  estimated  costs  of 

oach  of  the  a  ltematives.  The  personal  desires  of  the  client  and  hir. 
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intended  un  of  the  cose  results  will  determine  the  reco— coded  degree  of 
sophistication  in  the  technique  weed  to  celculete  end  empress  thle 
uncertainty.  If  only  e  rough  estiaate  of  thie  uncertainty  ie  needed,  the 
eaalyet  oey  etete  that  hie  beet  eetiaete  ie  that  the  systta  will  coat 
$30,000,000  end  that  he  believes  there  ie  only  one  chance  in  ten  that  the 
eyetaa  will  coat  lean  then  $33,000,000  or  aore  then  $73,000,000. 

however,  if  the  client  deai7ee  fuller,  auch,  aore  accurate  knowledge 
relative  to  uncertainty,  the  analyat  any  reaort  to  relatively  sophisticated, 
computer  oriented,  etetletlcel  aethoda  to  convert  the  uncertainty  for  each 
aeperete  coat  eleaent  into  an  espllclt  aeaaure  of  uncertainty  in  the  total 
coat  eetiaete.  The  output  of  thla  calculation  night  take  the  fora  of  a 
complete  probability  dlatributlon  of  eatiaated  costs.* 

2-9  lawifi 

Even  though  similar  teaka  confront  the  enelyat  whatever  the  type  of 
ayatea  be  ia  coating,  hla  approach  to  these  teaka  ahould  very  with  the 
purpose  of  the  estimate. 

Although  there  ere  many  specific  applications  of  coat  estimates, 
methodologically  speaking,  there  are  two  basic  types.  The  first  type,  a 
planning  estimate,  is  intended  as  an  input  to  a  ayatea  analysis  Study  and 
is  intended  as  a  tool  to  help  the  decision  maker  make  a  cost /effectiveness 
choice  among  systoi  alternatives  for  satisfying  a  specified  requirement. 

The  second  type,  a  funding  estiaate,  a  ins  to  provide  e  heels  for  soliciting 
funds  to  implement  a  specific  design  or  acquisition  program. 

The  methodology  for  accomplishing  these  two  basic  types  of  estimates 
differs  in  the  following  ways: 

a.  The  aoat  important  difference  is  in  the  concept  of  cost  alloyed. 

A  funding  type  estiaate  employs  a  "cash  flow**  concept  and  aims  to 
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stature  the  number  of  dollars'  required  to  inpleaent  4  program  or 
•ys tea.  A  planning  type  estimate  uses  a  "value  flow"  concept 


that  cotta  the  resources  of  a  ays tea  at  their  "alternative  use" 
value,  i.e.  the  estimated  value  of  a  system's  resources  if  they 
were  used  in  other  systems. 

b.  The  scope  of  costs  covered  is  another  important  difference. 

Although  either  a  planning  or  funding  type  estimate  may,  under 
certain  circumstances,legitimately  include  only  partial,  rather 
than  total,  system  costs,  the  excluded  costs  in  the  two  cases 
are  unlikely  to  be  the  same. 

c.  Although  it  is  desirable  to  minimise  error  in  any  type  estimate, 
the  requirements  for  accuracy  are  normally  greater  in  a  funding 
type  estimate  because  an  error  in  a  funding  estimate  is  likely  to 
require  greater  readjustments  in  other  military  programs  and  the 
civilian  econoezy. 

d.  Consistency  is  also  a  desirable  characteristic  in  all  estimates; 
however,  it  is  harder  to  achieve  consistency  in  planning  type 

estimates,  it  is  important  to  realize  that  a  uniformity  or  con - 

I 

slstency  in  procedure  does  not,  per  se.  insure  consistency  in  the 

'  I 

impact  on  total  system  costs  which  is  the  important  consistency 
criterion. 

e.  The  purpose  of  the  estimate  also  influences  the  relative  sophisti¬ 
cation  of  technique  that  is  appropriate.  For  instance,  planning 
type  estimates  normally  can  une  to  greater  advantage  complicated 
procedures  for  converting  cost  inputs  into  outputs  via  computer 
automated  cost  models  and  sure  sophisticated  techniques  for 
assessing  and  communicating  uncertainty  relative  to  the  cost  estimate. 


p«t« 
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The  possibility  of  saving  tine  is  only  one  of  the  advantages  offered  by  34 
a  computerised  cost  andel.  The  advantages  and  limitations  of  computerized 
coat  models  will  be  discussed  sore  extensively  in  Chapter  7. 

*  S ■  Sobel,  "A  Computerized  Technique  To  Express  Uncertainty  In  Advanced  35 
System  Cost  Estimates,"  The  MITBE  Corporation,  TM-3728,  (September  1963). 
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CHAPTER  3 


DESCRIBING  THE  SYSTEM 


3. 1  The  Historical  Record 

A  second  critical  task  in  costing  a  military  system  is  that  the 
analyst  must  pin-point ,  as  clearly  as  he  can,  what  it  is  that  he  is  to 
cost.  This  statement  is  such  a  common  sense  truisi^  and  it  has  been  re¬ 
peated  so  often,  that  it  represents  almost  a  platitude  to  restate  it  here. 
And  yet,  it  is  precisely  in  this  area  of  definic?  what  might  be  called 
the  non-financial  inputs  to  a  cost  estimate  that  cost  analysts  have 
historically  made  their  gravest  errors.  Although  similar  studies  have 
been  amde  by  several  organizations,  a  series  of  studies  over  a  number 
of  years  by  BAND  economists  have  repeatedly  shown  that  erroneous  non- 
financial  inputs  have  dwarfed  in  importance  errors  due  to  faulty  cost 
estimating  relationships  and  procedures. * 

Perhaps  it  would  be  more  precise  to  say  that  most  serious  errors 
in  advanced  system  cost  estimates  in  the  past  have  been  due  to  the  fact 
that  the  system  configuration  changed  substantially  from  the  tine  the 
cost  estimate  was  initially  prepared  to  the  time  the  system  became 
operational,  and  not  because  the  cost  analyst  wrongly  priced  die  resources 
that  constituted  the  initial  design  of  the  system.  Clearly,  if  there  is 
any  single  aspect  of  costing  military  system  that  presents  a  major 
potential  pay-off  task,  it  is  in  new  and  better  ways  to  define  what  is  to 
be  costed. 

Before  considering  hew  this  might  be  done,  it  night  be  relevant  to 
speculate  whether  some  of  the  gto.«ser  errors  in  anticipating  a  system's 
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configuration  night,  ba  due  less  to  technological  miscalculations  than  they 
are  to  senantic  conaiderationa.  Perhaps  it  would  sometimes  be  nore 
real ia tic  to  change  the  aye ten  deaignation  nonenclature  attached  to  aajor 
change a  in  a  prograa  than  to  regard  what  ia  essentially  a  new  program 
nerely  as  a  realignment  or  nodiJication  of  an  earlier,  "primitive"  concept. 

Conceivably  a  cost  nethodologist  could  conclude  fron  the  BAND 
historical  findings  described  above  that  die  error- in- ays ten-cos t-es tins  tea 
ia  not  hia  problen;  rather  that  it  ia  the  job  of  those  responsible  for 
setting  the  system  requirement  and  for  translating  this  requirement  into 
a  design  to  do  a  better  job  than  they  have  in  the  past.  For  two  reasons 
this  outlook  would  not  be  very  helpful.  If  the  coat  analyst  is  to 
produce  nore  accurate  cost  estlnates,  he  nust  be  concerned  with  exogenous 
as  well  as  endogenous  factors  bearing  on  his  estimate.  Second  and  nore 
inport ant,  in  entry  cases  the  coat  analyst  is  a  needier  of  a 
system  analysis  team  and  shares  responsibility  for  working  up  the  con¬ 
figuration  or  design  of  a  system,  and,  as  will  be  discussed  in  Chapter  10, 
in  sense  cases  presently  and  in  nore  cases  potentially  he  can  even  influence 
the  client's  objectives.  Sense,  it  is  quite  within  the  cost  smthodologist 
realm  of  responsibility  to  inquire  what  can  be  done  to  nore  accurately 
foresee  in  die  early  stages  of  a  r  stem's  development  the  nature  of  its 
design  in  the  later  stages. 

3.2  Sources  of  Error 

There  are  at  least  four  basic  sources  of  potential  error  in  the  non¬ 
cost  inputs  to  a  cost  estimate. 
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3.2.1  The  Threat  Analysis 

An  error  In  the  assessment  of  che  enemy  threat  is  the  first  step  in 
a  complicated  chain  that  can  ultimately  lead  to  an  erroneous  advanced 
systea  cost  estimate.  Thus,  it  might  be  assumed  that  air-breathing 
aircraft  constitute  the  only  threat  that  the  United  States  faces  from 
Country  A  in  a  designated  time  period.  Subsequent  analysis  say  determine 
that  the  United  States  faces  both  an  aircraft  and  missile  threat  froa 
Country  A  in  the  period  indicated. 

3. 2. 2  The  General  Mission  Requirement 

Assuming  a  certain  threat,  a  miscalculation  in  the  nature  of  the 
U.  S.  military  capability  needed  to  cope  with  this  threat  can  also 
ultimately  lead  to  a  cost  estimating  error.  Thus,  it  may  initially 
have  been  assumed  that  to  carry  out  a  designated  offensive  mission  it 
would  suffice  to  have  XX  of  United  States  aircraft  continually  airborne. 
Subsequent  analysis  may  disclose  that  2XX  is  a  better  figure. 

3.2.3  Specific  Performance  Capabilities 

Third,  even  if  the  threat  and  the  general  adssion  requirement  have 
both  been  correctly  assessed,  a  cost  estimating  error  can  arise  from  a 
miacalculatlon  in  the  specific  performance  requirement  needed  to  fulfill 
the  mission  requirement,  lor  instance,  it  may  have  been  estimated 
initially  that  to  fulfill  a  designated  defense  mission,  a  15-minute 
warning  time  would  suffice.  Later  study  My,  however,  reveal  that  to 
carry  out  this  mission,  a  20-minute  warning  time  is  required.  Or  it 
wiy  have  been  initially  calculated  that  a  command  post  hardened  to  200 
p.a. i.  would  provide  adequate  protection  against  a  designated  type  of 
enemy  threat.  Later  study  may,  however,  increase  this  figure  to  400  p.s. i. 
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3.2.4  Dasitn-Rcsource  Translation 

Fourth,  even  when  the  threat,,  the  general  alas  Ion  requirement,  and 
•ach  of  the  specific  performance  capabilities  needed  to  fulfill  this 
requirement  have  been  correctly  estimated,  errors  may  be  made  in  detarmlniiqi 
die  design  implication  of  achieving  these  capabilities.  In  other  words. 

It  Is  easy  to  err  in  determining  the  types  and  quantities  of  resources 
that  will  be  needed  to  achieve  a  designated  performance  level.  Sometimes 
this  is  described  as  configuration  uncertainty  where  ’’configuration" 


refers  not  only  to  the  physical  design  of  the  system,  but  also  to  a 
description  of  how,  where,  and  under  what  conditions  Jie  system  will  be 
used,  i.e. ,  the  employment  and  deployment  plans. 

Illustrative  of  the  types  of  configuration  error  that  nay  develop 
are  the  following: 


a.  It  nay  initially  have  been  estimated  that  a  single  unit 
of  a  state-of-the-art  computer  could  perform  the  data 
processing  necessary  to  provide  a  15-minute  warning 

i 

I 

time.  Later  study  nay,  however,  reveal  that  it  re¬ 
quires  three  units  of  a  beyond -the -state-of-the-art 
computer  -  each  involving  added  BDTUE,  Investment  and 
Operating  costs  -  to  provide  the  15-minute  warning  time. 

b.  It  any  initially  have  been  estimated  that  100  military 
personnel  after  three  months  training  at  a  average  cost 
of  $3,000  per  men  would  be  needed  to  adequately  staff  a 
designated  installation.  Later  study  may  disclose, 
however,  that  it  requires  200  personnel,  after  sir  months 
training  at  an  average  cost  of  $6,000  psr  man,  to  staff 
such  installation. 
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c.  It  is  not  uncommon  for  an  advanced  design  to  completely 
overlook  certain  important  resources  needed  to  attain  a 
designated  performance  capability.  For  instance,  in  a 
cm—  mication  systesi  it  night  be  overlooked  that  some 
military  bases  would  be  far  enough  apart  to  require  the 
system  to  have  repeater  stations. 

3.2.5  Cost  Estimating  Error 

In  contrast  to  the  foregoing  three  sources  of  error  in  non- f inane ial 
Inputs  to  a  cost  estimate  would  be  an  error  in  a  financial  input.  For 
instance,  in  illustration  b.  cited  above,  it  would  constitute 
a  cost  estimating  error  if  a  later  estismte  had  revised  the  cost 
of  a  three -month  training  program  from  $3,000  to  $4,000  per  man. 

3.3  Understand  inn;  The  System  Acquisition  Process 

3. 3. 1  A  Generalist's  Knowledge 

There  is  no  quick  and  easy  path  to  learning  how  to  forecast  in  the 
early  stages  of  a  system  project  what  the  final  configuration  of  the 
system  will  be.  There  are,  however,  both  immediate  and  long-term  steps 
that  a  cost  analyst  can  take  to  improve  his  ability  to  define  the  system 
he  is  to  cost. 

The  wisdom,  long  run,  for  the  cost  analyst  to  improve  his  knowledge 
of  the  total  system  acquisition  process,  is  indisputable.  Just  as  business 
firms  have  found  that  a  top  executive's  ability  to  detect,  diagnose,  and 
solve  practical  business  problems  depends  importantly  on  his  appreciation 
and  understanding  of  the  broad  economic  and  institutional  environment  in 
which  the  firm  operates,  similarly  «  coat  analyst's  ability  to  define 
accurately  the  system  he  is  to  cost  is  likely  to  be  enhanced  by  a  thorough 
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knowledge  of  the  administrative- technical  mechanics  of  the  system 
acquisition  process.  If  the  cost  analyst  has  acquired  a  good  under¬ 
standing  both  conceptually  and  historically  as  to  what  goes  on  as  a 
system  moves  from  a  concept  to  ar  operating  reality,  he  should  be  able 
to  identify  more  readily  the  specific  areas  in  his  own  study  in  which 
early  conceptions  are  likely  to  change,  and  what  are  likely  to  be  the 
resource  iaqilications  of  these  changes. 

3. 3. 2  The  Institutional  Process 

A  thorough  knowledge  of  the  institutional  process  through  which 

major  military  systeam  are  conceived,  developed,  and  introduced  is  a 

first  requiresmnt.  For  instance,  the  cost  analyst  should  be  fasdliar 

with  the  mechanics  of  the  Department  of  Defense  programing  system  and 

die  system  management  regulations  of  die  individual  military  services 

such  as  the  Air  Force  "375"  series.  These  regulations  are  supplemented 

by  a  growing  unofficial  literature  that  provides  a  valuable  conceptual 
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background  on  this  rotal  process. 

3. 3. 3  System  Design  Methodology 

Many  methodological  (normative)  studies  dealing  with  the  system  de¬ 
sign  process  have  also  been  published.  These  studies  generally  seek  to 
crystalixe  the  essential  tasks  in  developing  any  system,  and  to  point 
die  way  toward  an  objective  approach  for  accomplishing  these  tasks. ^ 

3.3.4  Historical  Studies 

To  supplement  an  institutional  and  conceptual  background  relative 
to  the  system  acquisition  process,  an  analyst  should  familiarise  him¬ 
self  with  the  historical  details  as  to  how  representative  major  military 
systems  have  developed.  Various  official  and  private  studies  have 
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reported  and  interpreted  the  histories  of  rertain  major  systems.  Ad¬ 
ditionally,  of  course,  if  the  analyst  can  gain  access  to  the  unpublished 
"system"  files  of  either  the  military  services  or  individual  contractors 
he  trill  find  much  useful  information  to  explain  how  and  why  specific 
systems'  objectives  and  configurations  have  changed  as  they  have  evolved 
from  concept  to  operation. 

In  this  connection  the  Program  Change  Proposal  System  of  the  Depart¬ 
ment  of  Defense  should  in  time  provide  valuable  historical  Insight  into 
what  happens  to  change  the  objectives  and  configurations  of  major  military 
systems.  Through  this  FCP  system  the  Department  of  Defense  has  sought 
to  systematize  the  procedures  and  documentation,  including  rationale, 
associated  with  making  changes  to  officially  approved  military  programs. 
Access  to  these  files  is,  of  course,  officially  controlled,  but  perhaps 
eventually  DOD  will  undertake  to  consolidate,  evaluate,  and  publish  the 
results  of  its  experiences  with  the  FCP  a  la  Peck  and  Scherer. 

3. 3. 5  Technological  Innovation 

The  development  of  a  modern  military  or  space  system  represents  one 
of  the  most  complex  practical  applications  of  systematized,  scientific 
innovation  that  can  be  four.d.  In  recent  years  a  number  of  interdiscip¬ 
linary  studies  have  sought  to  probe  the  general  historical  and  conceptual 
facets  of  the  innovation  process.  Selected  portions  of  this  work  are 
also  relevant  to  cost  analyses,  and  to  system  analysts  in  general,  who 
are  interested  in  becoming  more  adept  in  foreseeing  the  eventual  con¬ 
figuration  of  systems  while  they  are  still  in  the  conceptual  stage. ^ 
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3,4  Operating  Principles 

While  hs  ia  acquiring  a  v«l 1 -rounded  background  on  the  total  systee 
acquisition  precede  that  vlll  do  aore  than  anything  else  to  laprove  his 
long-run  coat  estiaatlng  abilities,  the  cost  analyst  can  laprove  al- 
aost  iaacd lately  his  ability  to  define  aore  accurately  the  systea  he  is 
to  cost.  He  can  do  so  by  following  certain  basic  principles. 

3.4.1  Clarifying  the  Cost  Analyst's  Responsibilities 

All  cost  analysts  do  not  have  the  sane  backgrounds,  and  the  constraints 
of  the  study.  Including  the  client's  wishes  relative  to  the  cost  analyst's 
responsibilities,  are  not  always  the  saae.  Ideally,  the  cost  analyst 
should  have  sufficient  background  in  engineering  and  related  disciplines 
so  that  he  is  capable  of  participating  aa  a  aeaber  of  the  systea  design 
te«g  In  practice,  this  say  not  be  the  case.  Even  if  he  has  the  necessary 
background,  the  administrative  ground-rules  of  the  study  say  preclude  hla 
froa  being  a  aeaber  of  the  design  teaa. 

Even  when  he  is  not  a  aeaber  of  the  systea  design  teea,  it  is  iapertant 
that  the  cost  analyst,  his  client,  and  hla  associates  having  other  disci¬ 
plinary  backgrounds,  recognise  that  the  aechanics  of  asking  a  cost  estisate 
properly  go  beyond  a  purely  cost-accounting  pricing  of  resources.  Although 
it  would  certainly  be  isq>roper  and  intolerable  tor  the  cost  analyst  to  rely 
on  his  judgaent  for  engineering- sc ientif ic  type  inputs,  it  is  equally 
certain  that  the  coat  analyst  should  be  persistent  in  pressing  his  client 
end  associates  relative  to  the  validity  of  these  Inputs  and  the  specific 
characteristics  of  the  systea  he  is  to  cost. 
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3  U  2  Pinpointing  the  System  ■  1  £~  ion 

Operationally  this  neans  that  the  cost  analyst,  if  he  is  not  a 
member  of  the  design  team,  should  engage  in  a  type  of  "20  questions" 
procedure.  At  the  onset  of  a  study  he  is  usually  apt  to  suffer  from 
serious  uncertainty  surrounding  the  general  statement  of  the  requirement 
and  also  from  the  fact  that  the  requirement  has  not  been  translated  into 
the  performance  specifications  and  the  design  configuration  necessary  to 
meet  it.  It  is  incumbent  on  the  cost  analyst  not  only  to  press  his 
client  for  greater  and  greater  clarification  of  the  general  statement 
of  the  requirement,  but,  equally  important,  to  insist  that  this  require¬ 
ment  be  translated  into  the  performance  specifications  and  design  con¬ 
figuration  -  including  an  identification  of  the  types  and  quantities  of 
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assets  and  services  needed  to  meet  the  requirement  If  he  is  a 
member  of  the  system  design  team,  he  is,  of  course,  in  a  better 
position  to  see  that  these  conditions  are  met. 

The  importance  and  value  of  this  translation  can  hardly  be  over¬ 
estimated.  The  responsibility  of  the  cost  analyst  is  to  determine  the 
resource  costs  of  attaining  a  future  capability;  however,  a  performance 
requirement,  itself,  does  not  directly  generate  a  resource  cost.  It  is 
strictly  through  the  medium  of  a  design  or  configuration  that  the  per¬ 
formance  requirement  can  be  translated  into  a  meaningful  statement  of 
resource  needs  This  is  true  because  almost  always  there  are  numerous, 
sometimes  almost  innumerable,  Jesign  alternatives  for  achieving  a 
designated  performance  requirement,  and  each  of  these  design  alternatives 
has  its  own  differing  resource  implications.  Any  statement  or  equation 
which  depicts  a  specific  relati  nship  between  performance  and  costs  must 
either  explicity  postulate  certain  design  assumptions  or  implicitly  assume 
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Of  course,  both  the  titae  constraints  and  the  nebulous  nature  of  the 
system  that  he  is  trying  to  cost,  will  frequently  oblige  the  cost  analyst 
to  settle  for  a  less  precise  definition  and  translation  of  the  require¬ 
ment  than  he  would  like.  This  is  likely  to  be  especially  true  when  the 
requirement  he  is  costing  implies  an  advance  in  the  technological  state- 
of-the-art.  However,  it  is  important  that  both  the  analyst  and  his  client 
be  fully  aware  that  in  settling  for  a  nebulous  and  incomplete  statement 
and  resource  translation  of  the  requirement  that  they  are,  perforce, 
increasing  the  range  of  uncertainty  and  the  likelihood  that  the  estimate 
may  be  seriously  wrong. 

3.4.3  Configuring  Technological  Improvements 

A  third  principle  is  an  outgrowth  of  the  second  and  is  directed 
toward  defining  and  costing  system  elements  involving  technological 
advances  beyond  the  current  state-of-the-art.  Frequently,  serious 
errors  are  committed  in  defining  and  costing  such  developments  largely 
because  the  approach  to  their  definition  and  costing  is  so  largeljrj 
intuitive. 

Admittedly,  it  will  never  be  possible  to  make  the  process  of  defin¬ 
ing  and  costing  new  developments  as  explicit  as  is  the  process  of  costing 
elements  entirely  within  the  state-of-the-art.  However,  the  process  of 
defining  and  costing  new  developments  can  be  made  much  more  systematic 
and  the  area  of  uncertainty  surrounding  such  developments  can  be  both 
greatly  reduced,  and  made  more  explicit,  if  it  is  realized  that  no  new 
requirement,  however  novel,  represents  a  complete  departure  from  everything 
that  has  gone  before.  Innovation  generally  consists  of  small  increments 
of  improvement,  and  usually  represents  new  combinations  of  established 
capebil ities.  One  leading  authority  has  suggested  a  rough  rule  of  thumb 
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that  the  typical  new  capability  in  the  area  of  component  requirements 
consists  of  “20  per  cent  new,  80  per  cent  old  It  should  be  a  major 
objective  of  the  cost  analyst,  with  the  nelp  of  his  client,  to  identify 
those  design  and  resource  implications  of  a  new  performance  capability 
that  raprasant  carryovers  from  the  existing  state-of-the-art. 

Planning  factors  and  cost  estimating  relationships  in  the  available  data 
baae  are  critically  important  in  identifying  these  carryovers  and  in  translatit 
pat— nee  requirement  into  a  design  configuration,  and  a  design  configura¬ 
tion  Into  a  resource  estimate  covering  the  types  and  qv*antities  of  asrets 
and  services  necessary  to  achieve  the  performance  requirement.  In  the 
firet  instance,  performance  chare. eristics  ere  the  independent  variables 
and  design  chsrsctsristics  the  dependent  variables,  snd  subsequently, 
design  characteristics  srt  the  independent  variables  snd  resource  require- 
nents  the  dependent  variables  Some  of  the  essential  conditions  of  this 
process  have  been  discussed  Is  previous  MITRE  documents*,  snd  additional 
observations  pertinent  to  the  operational  characteristics  of  this  pro¬ 
csss  will  be  discussed  in  Chapters  5  snd  6 

3.4  4  Reittratlna  the  System  Description 

A  fourth  important  prlncipls  to  be  observed  in  defining  the  system 
Co  be  costed  Is  that  in  an  advanced  planning  study  this  definition  must 
be  a  continuing  job,  not  a  one-shot  task  to  be  completed  at  the  beginning 
of  the  study  This  necessity  for  reiteration  in  definition  steam  from 
the  fact  that  at  the  onset  of  the  study  the  client  and  ihe  designers 
usually  have  only  S  vague  snd  fluid  notion  relative  to  the  details  of 
the  performance  goals  snd  of  the  design  details  necessary  to  meet  these 
goals  In  a  very  real  sense  tb *  cost  analyst  who  participates  in  an 
advanced  planning  study  is  shooting  at  a  moving  target  He  cannot 
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operate  effectively  in  isolation  free  the  other  anbert  of  the  study 
teas;  It  ia  crucial  that  he  establish  close  working  relationships  with 
the  engineering  and  scientific  staff  prismrily  responsible  for  the  design 
of  the  Byte*.  If  the  final  cost  estimate  ia  to  be  a  useful  input  to  the 
decision  maker  it  aust  reflect  the  resource  lapllcatlons  of  the  latest 
requirements  and  design. 

3.4.5  Quick  Response  and  Flexibility 

A  fifth  principle  fellows  from  the  fourth  and  stresses  the  need  for 
flexibility  and  rapid  response  in  estimating  procedure.  As  will  be 
pointed  out  in  Chapter  5.  the  lisiited  time  available  for  accomplishing 
the  cost  estimate  is  alsnst  always  a  constraint,  and  the  analyst  should 
be  able  to  change  quickly  the  quantitative  and  qualitative  characteristics 
of  the  system  he  ia  costing. 

Herein  potentially  lies  both  an  advantage  and  a  shortcoming  of 
certain  computerised  cost  models  which  mechanise  the  process  of  con¬ 
verting  cost  Inputs  into  outputs,  i.e.,  into  the  total  system  coat 
estimate.  When  a  project  requires  a  fairly  detailed  shred-out  cf  costs 
into  many  Interdependent  elements,  a  single  change  in  a  major  element  - 
such  as  mission  equipment  -  can  ramify  throughout  the  entire  structure. 

If  these  changes  must  be  reflected  through  many  alternative  configurations, 
the  sheer  calculation  involved  can  be  prodigious.  Under  such  circumstances, 
a  computerized  estimating  procedure  can  be  a  great  time-saver. 

On  the  other  hand,  if  it  becomes  necessary  to  reflect  qualitative 
changes  in  the  computer  model  -  such  as  a  change  in  the  elesmnts  structure 
or  in  the  definition  of  the  elements  -  it  suy  be  relatively  time  consuming 
to  do  so.  Normally,  it  is  desirable  to  avoid  such  changes  once  a  cost 
study  is  fully  underway,  whether  or  not  a  computerised  model  ia  being 
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used  to  process  the  cose  Inputs,  ask*  the  necessary  calculations,  and 
print  Che  resu.  However,  such  contingencies  do  sometimes  occur,  and 
It  is  well  for  the  cost  analyst  to  keep  the  need  for  flexibility  In 
his  procedures  in  mind. 

3.5  Si— ary 

The  aessage  of  this  section  has  been  cosquratively  simple  His- 
torically,  by  far  the  aost  Important  reason  for  poor  cost  estimates 
is  that  Che  system  *onf iguration  changed  substantially  from  the  tiae 
the  cost  cstiiMte  was  aade  to  the  time  the  system  became  operational. 

If  future  estiastes  are  to  be  better,  the  cost  analyst  and  those  from 
whoa  he  receives  his  descriptions  of  the  non-cost  characteristics  of 
the  system  meet  do  8  more  accurate  Job  of  defining  and  transleling  the 
requirement  to  be  costed.  The  cost  analyst  must  accordingly  make  these 
definitions  ar.d  translations  early  and  continuing  items  on  his  pro¬ 
cedural  aftanda.  If  he  fails  to  secure  thea,  he  does  so  at  great 
peril,  and  in  so  doing,  subjects  his  final  cost  estimate  to  the 
possibility  of  serious  miscalculation 
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Although  the  objective  sought  can  be  stated  simply,  there  is  neither 
a  quick  nor  an  easy  way  of  anticipating  in  the  early  stages  of  an  advanced 
system  study  the  eventual  configuration  of  the  operating  system. 

However,  the  cost  analyst  can  do  much  to  improve  his  long-run 
ability  to  define  more  accurately  the  system  he  is  to  cost,  if  he  strives 
to  learn  as  suet  as  possible  about  the  system  acquisition  process;  i.e., 
what  happens  es  a  major  military  system  proceeds  from  concept  to  operation. 
This  knowledge  should  be  both  descriptive  and  normative  and  should  cover 
the  historical,  legal,  admlnistrative-pol i tic  si ,  conceptual,  and 
technological  aspects  of  developing  a  system.  An  analyst  so  fortified 
with  an  intimate  knowledge  of  the  system  acquisition  process  in  each  of 
the  referenced  areas,  will  most  certainly  be  better  able  to  identify 

the  attributes  of  the  system  on  which  he  is  working  that  are  most  likely 

to  change  and  thus  be  better  able  to  anticipate  in  the  early  stages  of  a 
system  what  the  eventual  configuration  is  likely  to  be. 

While  he  Is  acquiring  this  long-run  background,  there  are  certain 
principles  that  he  can  observe  In  the  short  tun  to  minimise  the  chances 
that  he  will  commit  some  of  the  past  errors  of  smny  cost  estimators, 

a.  First  he  should  strive  for  a  broad,  rather  than  a 

narrow,  responsibility  on  the  sy..  tea  analysis  team. 

This  means  that  he  should  take  some  responsibility 
for  the  definition  of  the  system  he  is  to  coat.  In 
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practice  he  should  be  constructively  critical  of  the 
non-cost  inputs  relative  to  the  performance  require¬ 
ments  and  system  coni iguration  that  he  receives  from 
his  client,  his  associates,  or  that  he  provides  himself, 
b.  Second,  to  the  maximum  extent  that  time  and  data 

I 

permit,  he  should  seek  a  translation  of  the  general 
requirement  into  a  set  of  performance  specifications,* 

t 

anj  a  translation  of  these  specifications  into  a 
design  configuration  to  include  an  identification  of 
the  types  and  quantities  of  resources  to  achieve 
these  goals. 

It  vi 1 1  help  him  immensely  in  defining  and  costing 
a  development  beyond  the  state-oi - the-art  if  he 
recognizes  and  proceeds  on  the  sssomition  that  any 

new  de  velop  ment  generally  consists  of  new  combinations  ' 

of  things  that  have  been  done  before.  His  key  job 
in  defining  a  new  dr-elopment  tnus  should  be  aimed  at 

r 

identifying  these  carryovers  in  subsystem,  components, 
and  activities  for  which  he  can  find  performance, 
deaign,  and  cost-estimating/ relationships  in  the  general 
data  base. 

d.  In  an  advanced  system  study  it  is  particularly  important 
to  recognize  that  the  task  of  defining  the  system  is  a 
continuing  one,  not  a  one-shot  undertaking  to  be  completed 
at  the  beginning  of  a  study 

j 
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e.  Because  of  tne  evolving  character  of  the  system, 
cost  estimating  procedures  and  formats  should  be 
flexible  in  the  sense  that  new  inputs,  financial 
and  non>financial,  can  be  admitted  without 
complication  or  serious  loss  of  time. 
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CHAPTER  4 


S EL  ACTING  COST  CLASSIFICATIONS 

4*1  The  Cost  Structure 

Webster  lists  nine  or  ter.  definitions  of  the  word  ’’structure".  Some 
of  these  ere  specialised  to  particular  fields  of  science  such  as  geology, 
chemistry,  psychology,  etc.  However  as  used  in  this  document,  the  term 
structure  is  employed  in  a  rather  generic  sense  as  "an  arrangement  of 
parts  that  furnishes  some  insight  relative  to  the  functional  inter¬ 
relationships  among  theae  parts"  Thus,  a  cost  structure  is  an  arrangement, 
a  classification  or  a  subdivision  of  the  constituent  types  of  costs  in  a 
total  cost  estimate  that  furnishes  some  insight  concerning  the  relation¬ 
ships  of  these  costs  to  each  other  and  to  thr  1  '1*1  system  cost. 

4  2  The  Importance  Of  Piopet  P  IfrMil  U  at  ion 

It  is  important  to  discuss  the  subject  of  c.  'it  claMi  f  ication  in  a 
methodological  treatise,  such  as  Ibis,  for  at  thw*  reasons: 

a  In  most  actual  costing  projects  .  >n*tdr'*bl*  t  tire  is  spent  and 

often  controversy  generated  relative  to  the  preferred  classification 
scheme . 

b  A  substantial  portion  of  the  total  literature  labeled  system  cost 
methodology  is  concerned  with  cost  classification  schemes  and 
with  principles  relevant  to  making  such  classifications, 
c.  The  way  that  costs  are  classified  can  either  help  or  hinder  the 

analysis  and  decision-making  processes.  Whereas  one  classif icat icn 
scheme  will  shed  light  on  important  cause-effect  relations  ips. 
mother  will  obscure  tfv^se  relationships. 
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4.3  Cost  Format » 


A  total  system  coat  estimate  can  be  structured  in  many  different 
ways.  However,  for  the  purpoaea  of  thia  document  it  ia  uaeful  to  distinguiah 
between  two  baaic  types  of  coat  atructurea.  One  ia  an  input  format  that 
ia  intended  to  facilitate  the  collection  of  relevant  data  to  auike  the 
eatlmate.  A  aecond  type  la  an  output  format  that  ia  intended  to  facilitate 
the  presentation  of  the  findings  of  the  coat  study. 

With  a  few  notable  exceptions,  comparatively  little  time  has  gone 
into  developing  input  formats.  Most  attention  has  been  paid  to  sper'fying 
desired  output  formats  (reports),  with  the  question  of  the  format  under 
which  the  data  will  be  collected  left  to  the  discretion  of  the  reporting 
office. 

In  some  cases  an  analyst  may,  depending  upon  the  type  of  data 
available,  uae  the  same  format  to  collect  hla  data  and  to  report  his 
findings . 

In  other  cases,  the  input  format  My  be  drafted  in  (  msonance  with 
the  claaalf ication  scheme  of  a  fcrmal  departmental  data  bant1.  and  as  a  part 
of  a  sophisticated  cost  model.  MITXE  has  such  a  program;  the  objective  of 
a  coat  input  format  developed  in  connection  with  its  electronic  system  cost 
nodel  is  to  provide  a  relatively  detailed,  carefully  cross-classified 
scheme  whereby  it  is  possible  to  derive  several  different  output  formats 
from  this  one  input  format. 

4.4  Criteria  For  Classifying  Costs 

The  selection  of  a  cost  structure,  particularly  an  output  format, 

frequently  results  in  a  highlighting  of  one  type  of  cost  as  opposed  to 

some  other.  Thus,  if  one  type  of  cost  is  shown  on  a  first -level,  major 

element  status,  another  element  may  have  to  be  shown  on  a  lover  level, 
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sub-element  basis  in  which  it  may  lose  lt»  individual  identity.  Although 
sometimes  no  set  of  criteria  can  resolve  definitively  which  Is  the 
preferred  of  several  classification  schemes,  on  other  occasions  e  number 
of  criteria  can  be  invoked  to  irdicete  a  preferred  choice.  Illustrative 
of  these  criteria  are  the  following. 

A. 4.1  telatlvc  Magnitude 

A  classification  structure  should  normally  highlight  the  quantitatively 
largest  elements  and  relegate  the  smaller  elements  to  lesser  status.  This 
criterion  is  based  on  the  premise  that  cost  categorisation  should  help  the 
analyst  and  his  client  to  learn  as  much  as  possible  about  the  detailed 
make-up  and  behavior  of  the  individual  costs  that  are  most  relevant  to 
determining  the  magnitude  of  total  costs.  Expressed  differently, 
categorization  should  be  a  culling  device  that  differentiates  the  signifi¬ 
cant  from  the  insignificant.  Accordingly,  two  or  more  large  cost  items 
should  not  lose  their  separate  identities  by  being  consolidated  under  a 
single  element,  and  very  small  cost  items  should  not  be  reported  on  an 
equal  element  ^.atus  with  very  large  items. 


The  following  example  illustrates  this  criterion: 
Categorizat ion  1  Categorisation  11 


Cost  Item 

X  of  Total  Cost 

Cost  Item 

X  of  Total  Cost 

A 

20 

A 

20 

B 

70 

B1 

25 

C 

5 

B2 

30 

D 

3 

*3 

15 

E 

_ 2_ 

C,  D,  E 

10 

100 

100 
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In  th is  example,  Categorizat ion  II  by  separately  identifying  the  three 
largest  components  of  cost  item  B  would  generally  be  more  useful  both 
for  analytical  and  presentation  purposes  than  would  Categorization  I 
that  buried  these  three  Isrge  cost  components  under  one  element  and 
reported  as  separate  elements  the  smaller  items,  C,  D,  and  E. 

4.4.2  Purpose  of  the  Estimate 

the  specific  purpose  of  the  estimate  and  the  client's  intended 
application  of  the  estimate  as  discussed  in  Chapter  2  can  sometimes 
importantly  influence  the  preferred  classification  of  costs.  For 
instance,  it  may  be  important  in  an  estimate  oriented  toward  funding 
purposes  to  identify  separately  certain  relatively  small  cost  elements 
because  in  a  total  force  context  such  funds  are  in  short  supply  or  are 
politically  sensitive.  Also,  in  die  case  of  design-oriented  estimates 
covering  alternative  conf igurations  in  a  cost-effectiveness  study,  it 
becoams  Important  to  show  the  separate  cost  impacts  of  the  swst  cost- 
sensitive  elements  regardless  of  the  average  quantitative  impact  of 
these  elements. 

4.4.3  Type  of  System 

The  type  of  system  being  costed  obviously  influences  the  nature  of 
the  classif ication  scheme.  The  cost  structure  covering  a  detection  and 
warning  system  generally  is  likely  to  be  organized  around  the  sensor 
equipment  that  comprises  the  major  item  of  such  a  system.  On  the  other 
hand,  the  cost  structure  covering  a  headquarters  command  system  may  amke 
no  provision  for  sensor -equipment -re la ted  costs  since  the  system  typically 
has  no  sensor  equipamnt.  For  similar  reasons  the  cost  structure  per¬ 
taining  to  a  weapons  systeam  will  normally  differ  in  important  particulars 

from  that  of  electronic  systems,  especially  at  the  minor  element  level. 
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Finally,  although  there  are  sound  reasons  for  normally  separating  develop* 
■ant  (RLT&E)  from  investment  costs,  some  systems  require  practically  no 
development  costs  and  when  this  la  true  there  nay  be  little  to  gain  from 


•operating  die  two  types  of  costs. 

4.4.4  Availability  of  Data 

In  establishing  a  set  of  cost  categories  and  elements  to  be  used  in 
costing  a  system.  It  must  be  considered  Aether  data  can  be  collected  to 

complete  the  preferred  categorizations.  This  means  that  a  check  mist  be 

*'  |  I1' 

made  relative  to  the  formats  and  reporting  regulations  under  which  the 
military  services  and  the  Department  of  Defense  collect  their  data  and 
the  back-up  accounting  records  maintained  by  industry.  As  a  practical 
matter  it  may  frequently  be  necessary  to  compromise  on  using  a 
theoretically  preferred  set  of  categories  and  elements  simply  because  the 
government  and  industry  do  not  compile  and  classify  basic  cost  data  in  a 
manner  such  that  it  would  be  readily  possible  to  segregate  costs  into 
these  categories  and  elements.  For  Instance,  on  occasions  it  would  be 

i 

interesting  for  planning  purposes  to  estimate  separately  the  operating 
and  maintenance  portions  of  military  personnel  costs.  However,  official 
data  sometimes  do  not  make  this  distinction.  Also,  at  times  it  would  be 
interesting  to  know  the  separate  costs  for  material  and  labor  charged 
under  industry  equipment  maintenance  contracts.  Again,  these  data  are 
not  always  available. 

4.4.5  Discreteness  in  Definition 

Apart  from  the  particular  purpose  of  an  estimate  or  the  type  of 

system  being  costed,  it  is  desirable  that  cost  categories  and  elements 

be  defined  so  as  to  be  discrete  md  mutually  exclusive.  Both  conceptually 

and  administratively  a  cost  structure  should  differentiate  clearly  between 
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one  type  of  coat  and  another,  ideally  there  should  be  no  question  regarding 
the  specific  category  or  element  under  which  a  type  of  cost  has  been 
recorded  or  is  to  be  recorded.  Conceptually,  it  is  sosmtiams  difficult 
to  avoid  overlap  and  to  draw  these  boundary  lines  clearly.  Even  in  these 
cases,  however,  it  is  important  that  precise,  albeit  somewhat  arbitrary, 
definition  be  used  to  avoid  any  misunderstanding  between  the  cost  analyst 
and  his  client  as  to  how  the  marginal  cases  have  been  handled. 

4.4.6  Completeness  in  Coverage 

Before  finally  selecting  a  classif ication  scheme,  a  check  should  be 
amde  to  insure  that  all  relevant  types  of  costs  have  been  provided  for. 

This  amans  that  provision  should  normally  be  made  to  Include  the  life- 
cycle,  total  activity  costs  of  a  system  unless  the  special  purpose  of 
an  estiamte  dictates  otherwise.  Chapter  3  discussed  some  of  the 
conditions  under  which  a  partial  cost  estimate  would  be  relevant.  As 
indicated  previously,  it  is  very  important  to  justify  such  partial  analysis. 
4.5  Advantages  of  Standardised  Cost  Structures 

To  take  a  vantage  of  the  numerous  advantages  discussed  below, 
practically  all  organisations  that  have  established  a  formal  system 
cost-estimating  capability  have  developed  standardised  cost  structures 
that  can  be  used  from  system  to  system  and  from  one  costing  project  to 
the  next.  Seme  of  the?e  advantages  are  general  in  character  and  are 
long  run  in  impact;  others  have  short-run,  isawdiate  benefits  for 
particular  costing  projects. 

4.5.1  Conceptual  Superiority 

Standardised  cost  structures  normally  are  more  likely  to  meet  most 

of  die  criteria  discussed  in  Section  4.4  of  this  chapter  than  are  the 
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cost  structures  developed  in  the  course  of  an  individual  costing  project. 
This  is  true  because  generally  much  greater  care  and  thought  go  into  the 
development  of  standardized  cost  structures  than  into  the  cost  structures 
developed  to  satisfy  purely  the  requirements  of  particular  costing 
projects.  As  will  be  discussed  in  Chapter  5,  the  cost  analyst  working 
cn  a  particular  costing  project  is  usually  faced  with  a  serious  time 
constraint  and  he  is  not  normally  in  a  position  to  be  meticulous  in 
defining  each  cost  element  and  in  ensuring  that  the  total  structure  is 
complete  and  internally  consistent.  On  the  other  hand,  generalized  or 
standardized  cost  structures  are  usually  developed  as  methodological 
projects  and  specific  provision  is  msde  for  the  thoroughness  in 
procedure  sometimes  lacking  in  Individual  projects. 

Similarly,  a  generalized  cost  structure  developed  in  detached 
isolation  from  the  peculiar  biases  of  any  particular  project  is  more 
likely  to  take  into  consideration  broad,  basic,  long-run  concepts  and 
and  principles  that  are  relevant  to  all  systems  and  system  projects. 

A  cost  structure  tailored  solely  to  fit  the  iassediate,  peculiar  needs 
of  one  project  is  likely  to  sacrifice  conceptual  neatness  for  practical 
expediencv.  The  consequences  of  this  sacrifice  are  enumerited  in  the 
aub-sections  that  follow. 

4.  5.  2  Time  Conserving 

The  availability  of  a  standardized  cost  structure  conserves  time 
of  the  analyst  on  any  costing  project  because  it  greatly  reduces  the 
amount  of  time  that  he  mist  spend  in  such  cost  preliminaries,  as  defining 
his  cost  elements.  Such  availability  thus  makes  it  possible  for  the 
analyst  to  spend  his  limited  tire  on  the  very  isqiortant  functions  of 
collecting  and  evaluating  dati . 


61 


4.5.3  Completeness  Check-List 


Following  from  several  of  the  advantages  cited  above  (particularly 
4.5.1),  a  standardised  cost  structure,  since  it  aias  to  be  thorough  and 
exhaustive,  serves  as  a  valuable  check- list  to  ensure  that  no  important 
cost  eleswnts  have  been  overlooked  in  developing  a  specialised  cost 
structure  for  a  given  project. 

4.5.4  Intersystesi  Comparison 

The  use  of  standardised  cost  structures  facilitates  a  comparison 
of  the  cost  findings  of  different  studies  completed  by  different  analysts 
over  tiaw  since  the  standardised  elesKnt  definitions  insure  a  consistent 
Kindling  of  difficult  and  controversi  il  conceptual  issues  relative  to 
such  definition. 

4.5.5  Palm  History 

Standardised  cost  structures  help  the  analyst  extract  the  awxiaRSS 
possible  benefit  from  historical  data  on  the  cost  experiences  of  previous 
systems.  This  is  iaportant  because  the  ability  to  forecast  future  costs 
accurately  is  related  rather  directly  to  the  volume  of  usable  historical 
experience  that  can  be  applied  to  such  forecasts.  To  take  one  example, 
without  a  substantial  comparability  of  cost  element  definitions  from 
system  to  system  and  from  project  to  project,  it  would  be  extremely 
difficult  to  develop  reliable  cost-estiamting  relationships  (see  Chapter  6), 
an  indlapenslble  tool  in  forecasting  future  costa.  For  instance,  if 
equipment  maintenance  costs  were  defined  differently  in  every  costing 
study,  historical  comparisons  of  maintenance  costs  for  similar  equipment 
from  system  to  system  would  b*  of  very  limited  value. 
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4.5.6  Analyst-Client  Consaunlcatlon 

A  standardised  cost  structure  facilitates  cosaunlcatlon  and  minimises 
misunderstandings  between  a  cost  analyst  and  his  client,  especially  when 
there  Is  the  rtquiresmnt  for  repeated  contacts  on  suc***«lvc  projects 
between  the  cost  analyst  and  a  given  client. 

4.5.7  A  Methodological  Base 

A  standardised  cost  structure  contributes  to  a  generally  improved, 
objective,  methodological  base.  In  system  costing,  as  in  any  field  of 
learning,  it  would  be  impossible  to  go  far  toward  developing  sophisticated 
techniques  for  handling  difficult  areas  of  cost  (see  Chapter  6)  until  there 
had  been  fairly  general  agreement  on  terminology.  An  important  segment  of 
this  terminology  consists  of  the  definitions  and  the  classification 
interrelationships  among  the  types  of  activities  and  resources  that  are 
to  be  costed. 

4.6  Cost  Structures  in  Current  Use 

As  indicated  in  Section  4.5,  most  agencies  and  organizations  engaged 
in  costing  military  system  have  endeavored  to  introduce  some  degree  of 
standardization  into  their  cost  structures.  The  extent  of  this 
standardization  has  varied  considerably  among  organisations  and  applications. 
Also,  as  indicated  previously,  more  attention  has  been  paid  to  standardizing 
system  cost  output  formets  (reporting  or  presentation  formats)  than  to 
standardizing  input  formats,  the  classif ication  schemes  used  to  collect 
tho  data  necessary  to  complete  the  output  formats. 
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There  ere  both  officiel  end  unofficial  system  cost  estimating  output 
formats.  The  officiel  formats  consist  primarily  of  reports  required  from 
solitary  contractors  by  military  agencies  plus  those  required  by  higher 
echelon  military  agencies  from  lower  echelon  agencies. 

j 

One  of  the  a»st  frequently  prescribed  bases  for  presenting  official 
:ystev  cost  estimates  is  by  Congressional  Appropriation  Codes,  the 

i 

categories  into  which  Congress  subdivides  and  distributes  the  total 

*■  I  l 1 

military  budget. 

The  Air  Force  portion  of  the  Appropriation  Codes  contain  sixteen 
(16)  codes  or  elements.  Seven  (7)  of  these  are  major  elements,  dollarwlxe, 
from  a  ays team*  point  of  view: 

Aircraft  Procurement 
Missile  Procurement 

t 

Other  Procurement  (including  Electronics) 

Military  Construction 

i 

Operations  and  Maintenance 
Military  Personnel 

Research,  Development,  Test,  and  Evaluation 

i 

The  other  nine  (9)  codes  cover  such  activities  as  Reserve  Forces,  the 
Air  National  Guard,  Retired  Pay,  etc. 

Another  widely  used  suaoary  classification  is  by  the  three  major 
activities:  Research,  Development,  Test,  and  Evaluation;  Investment; 
and  Operations. 


Some  of  the  reports  classified  on  either  or  both  of  these  bases  are: 

a.  The  Department  of  Defense's  Force  and  Financial  Plan,  is 
a  report  which  lists  the  several  hundred  DOD  officially 
approved  programs  for  the  three  Military  Services.  This 
report  subdivides  the  costs  of  the  major  military  programs 
both  by  the  appropriation  codes  snd  by  the  three  msjor 
categories  -  development,  investment,  and  operations. 

b.  The  DOD  Program  Change  Report,  the  report  used  by  the 
Three  Services  to  request  changes  in  DOD  officially 
approved  programs,  also  subdivides  the  costs  of  the 
revised  programs  into  the  development.  Investment, 
and  operations  categories 

c.  The  System  Acquisition  Program  reports,  used  by  the 
AFSC  Division  (ESD,  ASD,  BSD,  and  SSD)  to  propose 
new  programs  to  AFSC  and  Higher  Headquarters,  also 
subdivides  system  costs  into  the  appropriation  codes 
identified  above  plus  the  development,  investment,  and 
operations  codes.  The  Proposed  System  Package  Program, 
the  document  that  covers  the  Definition  Phase  of  the 
Acquisition  Program,  provides  for  a  finer  subdivision 
of  costs  under  the  appropriation  codes.  The  fonaat  of 
this  finer  subdvision  is  within  the  discretion  of  the 
office  preparing  the  report. 

Air  Force  financial  reports  from  the  lower  echelons  to  high  echelons 
have  also  subdivided  the  Appropriation  Codes  data  into  two  further  levels. 
First,  there  has  been  a  breakdown  of  the  Appropriation  Codes  into  numerous 
Budget  Program  Activity  Codes  (rpAC),  plus  a  four-level  breakdown  of  the 
BPAC  Codes  into  many  detailed  Material  Procurement  Codes  covering  Invest¬ 
ment  (swinly  hardware)  type  costs.  For  Commend  and  Control  Systems 
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the  first  or  major  level  breskdown  of  the  Material  Program  Codes  has 
included  a  system  integration  or  system  engineering  element  plus  five 
mission  equipment  codes  --  radar  and  sensors,  electronic  data  processing 
equipment,  communication  equipment,  data  display  equipment,  and  other 
mission  equipment. 

Two  major  reporting  systems  by  which  contractor  costs  are  reported  to 
the  Air  Force  are  the  Contractor  Cost  Studies  and  the  PERT  (Program  Evalu¬ 
ation  Review  Technique).  The  formats  for  these  reports  presently  are  not 
standardized. 

As  this  is  being  written,  the  Department  of  Defense  has  issued  a  new 
directive  that  seeks  to  standardize  reporting  to  DOD  by  the  three  Servi-.es.* 
The  electronic  system  portion  of  this  report  has  not  yet  been  published. 
However,  the  aircraft  and  missile  portion  provides  for  a  three-level 
breakdown.  "Level  Zero"  provides  for  a  classification  of  costs  by  major 
weapon  system.  "Level  One'*  provides  for  a  mandatory  seven  (7)  element 
subdivision  for  each  major  system  as  follows: 

Vehicles  or  Mission  Equipment 

Support  Equipment 

Systems  Engineering 

Systems  Tests 

Training 

Site  Activation 

Other  (primary  Documentation) 

"Level  TVo”  provides  for  a  28  element  subdivision,  nine  (9)  of  which  are 
awindatory.  Six  (6)  of  the  mandatory  codes  cover  mission  equipment  codes; 
the  other  three  (3)  cover  system  integration,  military  construction,  and 
documentation. 

Most  non -government  oi janlzations,  such  as  RAND  and  MITRE,  engaged  in 
costing  military  systems  also  have  developed  standardized  cost  output  formats. 
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Thus,  chc  major  or  luaury  format  utilized  in  moat  MITRE  ayatso  coating  studies 
during  the  laat  three  year#  ha  a  been  as  follows: 

Research.  Development .  Test  and  Evaluation 

System  Design  and  Management 

Subsystem  Development  and  Testing 

System  integration,  Testing  ar.d  Evaluation 

Initial  Investment 
FaC i 1 it ies 

Mission  Equipment*  and  AGE  (Aerospace  Ground  Equipment) 

Initial  Spares  and  Stocks 

Computer  Program  Production 

Personnel  -  Initial  Training  end  Travel 

Annual  Operations 

Facilities  Maintenance 
Equipment  Replacement  and  Maintenance 
Communications  and  Equipment  Rental 
Computer  Program  Maintenance 
Perscrr^cl 

The  above  format  is  also  utilized  as  one  of  the  cost  presentation 
formats  in  connection  with  MITRE ‘ s  Electronic  System  Cost  Model.  The 
MITRE  Cost  Model  also  provides  a  more  detailed  subdivision  of  the  above 
format  plus  a  classification  of  costs  by  appropriation  codes  of  the 
summary  format,  the  various  subsystems  and  the  major  hardware  subsystems.^ 

4.6.2  Input  Formats 

In  collecting  cost  data  inputs  the  analyst  sometimes  uses  an  integrated 
format  that  makes  it  possible  to  present  his  findings  in  terms  of  several 
alternative  output  formats  and  at  several  alternative  levels  of  aggregation. 
Thus,  MITRE’s  system  cost  data  base  and  electronic  system  cost  model  are. 


Mission  equipment,  because  it  » i  usually  much  larger  t^-sn  the  other  cost 
elements,  is  normally  subdivided  into  major  types  in  this  suataary  format: 
sensors,  communications,  data  processing,  displays,  aerospace  vehicles,  etc. 
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for  instance,  organised  around  an  input  f onset  which  stresses  the  Major 
subsystems  with  a  separate  element  for  "General  System"  costs  which  cut 
across  several  or  all  subsystems.  The  first  level  subsystem  breakdown 
is  as  follows: 

Ceneral  System 
Data  Processing 
Data'  Presentation 
Communication 
Data  Acquisition 
Aerospace  Vehicles 
Computer  Programs 
Personnel 

Facilities  and  Support 

Four  further  subdivision  levels  are  provided.  Thus,  for  example, 
the  Data  Processing  Subsystem  portion  of  the  input  format  is  subdivided 
as  follows: 
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Date  Processing  Subsystem 
Mission  Equipment 

Development,  Test,  and  Evaluation 

Analysis  and  Design 

Fabrication  for  Test 

Mockups,  Prototype  and  Other 

Develop  Tool  and  Teat  Equipment 
Test  and  Evaluation 

Procurement  and  Installation 
Prime  Equipment 

Mission  Hardware 
Special  Tooling 

Data 

First  Destination  Transportat ion 
Installation  and  Checkout 

Initial  Spares 
Spares 

Transportation  of  Spares 
Aerospace  Ground  Equipment  (AGE) 

Development  Test  and  Evaluation 
Procurement  and  Installation 

Equipment 

Data 

First  Destination  Transportation 
Installation  and  Checkout 
Initial  Spares 
Spares 

Transportation  of  Spares 
Replacement  Maintenance  and  Rentals 
Materials  and  Services 
Follow-On  Spares 

Transportation  of  Follow-On  Spares 
Equipment  Replacement 
Subcontract  Maintenance 
Rentals 


4.7  Suama  ry 

Cost  classif ication  is  a  methodological  tool  which,  if  properly 
utilized,  can  facilitate  the  analysis  and  dec  is  ion -sulking  processes  relative 
to  the  selection  of  military  systems. 

Numerous  criteria  can  be  referenced  in  developing  a  cost  classification 


scheme  that,  on  the  one  hand,  w.ll  guide  the  collection  of  cost  data  and 

that  on  the  other  hand,  will  serve  as  an  output  format  for  displaying  the 
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findings  or  results  of  s  particular  cost  study.  The  choice  of  e  particular 
cost  struccure  is  usually  influenced  by  two  opposing  forces.  First,  there 
are  msny  compelling  reasons  for  using  standardized  cost  structures  from 
system  to  system  and  from  project  to  project.  Second,  the  peculiar 
constraints,  characteristics  or  objectives  of  a  particular  costing  project 
often  seem  to  favor  a  custom  tailored  cost  structure  especially  formulated 
to  suit  these  peculiarities. 

There  are  no  iron-clad,  objective  guide-lines  that  can  be  referenced 
to  dictate  the  precise  mixture  of  standardization  and  variation  that  should 
prevail  in  the  cost  structure  of  a  given  study.  In  compromising  the  issue 
in  day-to-day  operations  two  principles  are  paramount.  First,  cost 
classlf lcation,  like  any  other  amthodological  tool,  exists  to  service, 
not  to  stymie,  the  analyst  and  decision-maker.  Second,  even  under  the 

I 

most  special-  circumstances  a  standardized  or  generalised  cost  structure 
can  serve  as  a  frame  of  reference,  as  a  point  of  departure,  for  the 
developsmnt  of  a  cost  structure  specially  tailored,  to  suit  die  needs  of 
a  given  system.  Because  of  the  substantial  benefits  to  be  derived  from 
standardisation,  the  cost  analyst  should  feel  obliged  to  justify  smjor 
deviations  from  a  standardised  structure  where  one  exists. 
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tail 

^Department  of  Defer se,  Cot  and  Economic  Information  System.  (July  1964)  66 

2 

Detailed  definitions  for  these  elements  is  provided  in:  M.  V.  Jones,  67 

"A  Generalised  Cost  Structure  for  Electronic  Systems,"  The  MITRE 
Corporation,  TM-3299  (May  1962).  Details  on  the  cost  foraaLS  and  on 
other  features  of  the  MITRE  Cost  Model  are  provided  in:  T.  J.  Jannsen, 

H.  Glaser,  J.  C.  Destoches,  "User's  Manual  for  the  Computerised 
Electronic  System  Cost  Model,"  The  MITRE  Corporation,  TM-3651  (July  1963). 
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CHAPTE*  3 


FUHKIRG  THE  COSTING  EFFORT 

3.  i  The  Tims  Constraint 

Almost  invariably  the  coat  analyst  has  lass  tine  than  ha  would  like 
to  make  a  thorough  and  reliable  cost  estimate.  Normally  the  cost 
eatimate  is  only  one  input  to  a  broad  system  analysis  effort,  and  the 
cost  analyst  has  little  to  say  about  the  deadline  of  the  overall  project. 
Usually  such  deadlines  are  governed  by  the  requirements  of  the  client. 
Under  some  circumstances  the  cost  analyst  may  be  free  to  decide  whether 
or  not  he  will  participate  in  a  project.  His  decision  to  refrain  from 
participating  will  usually  be  based  on  the  position  that  only  a  very 
poor  cost  estimate  could  be  compiled  in  the  limited  time  available  and 
that  it  would  be  better  to  ignore  economic  considerations  as  one  of  the 
decision  criteria  rather  than  to  risk  being  misguided  by  grossly 
unreliable  cost  data.  However,  if  he  decides  to  participate,  the  cost 
analyst  usually  has  to  accept  the  time  constraints  of  his  client. 

Since  the  coat  analyst  norsmlly  has  less  time  than  he  would  like 

to  do  his  part  of  the  task,  it  is  appropriate  that  he  give  serious 

consideration  at  the  start  of  a  project  as  to  how  he  can  most  profitably 

employ  his  tis*.  The  matter  of  using  limited  time  wisely  can  be  viewed 

from  several  perspectives.  One  basic  decision  concerns  the  amount  of 

time  that  should  be  spent  on  "pre -cos ting"  activities  vs.  actual  cost 

estimating  and  analysis.  These  pre-costing  activities  cover  the 

conceptual-technical-administrative  ground-rules  of  the  costing  phase  of 

the  project.  They  concern  the  type  of  questions  raised  in  Chapter  2 

72 


concerning  the  purpose  of  the  estimate,  Including  how  "cost"  will  be 
defined  for  the  partlculer  project,  whet  will  be  the  scope  of  the  cost 
analyses  responsibilities, end  how  important  ere  such  matters  es  precision, 
consistency,  soph 1st ice t ion  of  as t hod ,  etc.  They  elso  concern  the  aaount 
of  tie*  thet  will  be  spent  in  describing  the  jystem(s)  to  be  costed  es 
discussed  in  Chepter  3  end  the  problems  involved  in  spelling  out  the 
cost  structure  es  discussed  In  Chepter  4.  How  these  aetters  ere  decided 
say  determine  whether  or  not  the  cost  enelyst  vents  to  perticlpete  In  the 
project.  Unfortunetely,  there  ere  no  hard-and-fast  rules  for  deciding  how 
auch  tiae  on  e  given  project  should  be  spent  on  these  pre-cost  vs.  the 
costing  tesks.  However,  es  ceutioned  previously.  It  is  unwise  to  slight 
the  pre-cost  tesks  since  hlstoricelly  aany  estisates  have  gone  wrong 
because  these  pre-cost  tesks  were  dispensed  with  too  quickly. 

After  the  analyst  has  resolved  these  pre-cost  tesks,  including  a 
suitable  structuring  of  the  elesants  to  be  costed,  he  has  next  to  decide 
how  he  best  can  allocate  his  Halted  tiaa  to  gathering  and  analysing 
data  relative  to  each  of  these  elements.  Rarely  wilij  it  be  advantageous 
to  distribute  his  tiaa  equally  aaxmg  all  cost  elements,  and,  when  it  is 
not,  he  aust  decide  which  ones  he  will  stress  and  which  ones  he  will 
slight. 

In  the  process  of  deciding  how  he  will  allocate  his  Halted  tiaie 
researching  the  different  cost  elesants,  the  analyst  should  gather  enough 
preliminary  information  to  assess  the  various  cost  elements  froa  at  least 
the  four  points  of  view  discussed  in  the  four  sections  of  this  chapter 
that  follow.  There  are  several  ways  he  can  sake  these  preliminary 
assessments  with  only  a  modest  investment  of  tiae.  One,  if  he  is  an 


experienced  analyst,  he  can  draw  upon  his  own  reservoir  of  experience 
concerning  pest  costing  projects  that  on  preliminary  review  seemed  to 
have  been  similar  to  the  systesi  he  is  presently  trying  to  cost  Insofar 
as  the  criteria  that  follow  are  concerned.  If  he  does  not  have  extensive 
experience  he  should  seek  the  counsel  of  more  experienced  analysts  in 
deriving  these  initial  impressions.  Even  if  he  is  experienced,  it  will 
pay  hla  to  cross-fertllite  hla  own  Judgment  with  other  specialists 
assigned  to  the  project.  Including  experts  in  other  disciplines.  Finally, 
as  in  describing  the  systea  (Chapter  2),  he  should  regard  this  task  of 
allocating  his  tine  wisely  as  a  continuing  responsibility  throughout  the 
study,  not  as  a  one -t is*  decision  to  be  aade  at  the  start  of  the  project. 
5-2  lelatlve  Magnitude 

First,  he  should  sake  a  rough  preliainary  estimate  either  of  the 
dollar  or  percentage  contribution  of  each  major  cost  eleaent  to  the  total 
systea  cost.  All  other  things  being  equal,  the  amount  of  tiaa  spent  in 
researching  a  cost  eleaent  should  Increase  with  the  magnitude  of  that 
eleaent's  estlaated  value.  Thus,  anticipated  large  cost  elesents  should 
be  studied  sore  carefully  than  saall  ones,  since  the  sacs  percentage 
error  in  a  large  cost  eleaent  will  distort  the  total  cost  estiaate  more 
than  will  a  similar  error  in  a  smell  cost  element.  For  instance,  all 
other  things  being  equal,  more  time  should  be  spent  in  researching  cost 
element  A  than  B  under  the  following  circumstances; 


Cost  Elements 

A 

B 

C,  D,  E,  etc. 
Total  Systea  Cost 


Anticipated  Value 


560 

3 


_37 

$100 


7* 


A  practical  instance  of  this  above  principal  is  to  be  found  in  the 
case  of  mission  equipment.  For  most  systems  mission  equipment  is,  by 
far,  tha  largest  cost  element;  in  soma  cases  mission  equipment  costs  are 
almost  as  large  as  all  other  system  costs  combined. 

5. 3  Potential  Variation 

Second,  to  the  extent  that  t ime  and  data  permit,  the  cost  analyst 
should  make  a  preliminary  assesssmnt  of  the  potential  variation  that  may 
be  encountered  in  the  estimated  value  of  at  least  the  major  cost  elements. 
This  variation  has  two  facets.  One  occurs  when  costing  several  alternative 
configurations  of  a  system  and  concerns  the  relative  sensitivity  of  a 
system's  total  cost  to  changes  in  the  values  of  a  system's  performance 
parameters.  The  sore  cost  sensitive  Is  a  particular  parameter,  the  more 
study  it  should  receive. 

The  other  type  of  potential  variation  can  occur  when  costing  either 
a  single  or  multiple  configure tion(s)  of  a  system.  This  variation  is  a 
function  of  the  uncertainty  surrounding  the  value  of  an  element  and  is 
measured  by  the  dispersion  about  sosk  measure  of  the  estimated  value  of 
the  element.  All  other  things  being  equal,  the  greater  the  uncertainty  - 
the  greater  the  anticipated  dispersion  about  the  estimated  value  -  the 
greater  the  asount  of  time  that  should  be  spent  in  researching  that  cost 
element.  Stated  correlatively,  the  analyst  should  not  spend  a  lot  of 
time  researching  those  costs  that  he  can  establish  with  reasonable 
certainty  at  the  beginning  of  the  study.  Thus,  all  other  things  being 
equal,  sore  tin  should  be  spent  in  researching  cost  element  E  than  P 
under  the  following  circumstances; 
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Cot  Eleaent 


Estimated  Value 
(Millions  of  Dollars) 


Anticipated 
Dispersion 
(including  95Z 
of  all  cases) 


E  $55 

r  $55 

C,  I,  I.  ate.  $90 

Total  Systea  Coat  $200 


$40-55-150 

$50-55-60 

$60-90-115 


5.4  taaaarch  Pay  Off 

Third,  and  aaong  the  aost  important,  the  analyst  should  aake  an 
appraisal  of  the  relative  ease  or  difficulty  he  will  encounter  in 
trying  to  obtain  useful  data  to  reduce  the  anticipated  dispersion  about 
the  eatiaeted  values  of  his  sajor  cost  elements.  All  other  things  being 
equal,  the  sure  tractable  the  research  problea  appears,  the  aore  it  sill 
pay  to  devote  the  tiae  to  do  that  research.  For  instance,  under  the 
following  circumstances,  it  would  be  preferable  to  research  cost  eleaent 
R  rather  than  S: 


Anticipated  Value 
and  Dispersion 

Cost  Eleaent  (Millions  of  Dollars) 

Before  Research  After  Research 

R  $30-55-90  $50-60-65 

S  $30-55-90  $35-60-85 

T,  0,  V,  V,  etc,  $40-90-130 


The  above  point  has  particular  application  in  costing  advanced 
systeas  in  that  the  search  for  useful  data  is  sharply  subject  to  the 
law  of  dialnishlng  returns  and  it  is  hard  to  reduce  uncertainty  and 
dispersion  beyond  a  certain  point.  For  instance,  whereas  it  Bight  be 
profitable  to  spend  10  hours  research  analysing  the  findings  of  a 
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previous,  exhaustive  study  of  an  analogous  cost  element  for  a  similar 
type  system,  another  80  hours  of  research  going  beyong  the  findings  of 
this  previous  study  might  yield  no  additional  data  that  could  further 
reduce  the  anticipated  dispersion. 

In  attempting  to  smite  this  research-tractability  assessment,  the 
analyst  should  try  to  pinpoint  the  factors  that  make  for  the  uncertainty 
surrounding  the  various  cost  dements.  Thus,  in  some  cases  uncertainty 
may  be  due  to  the  fact  that  basic  government  and  industry  accounting 
records  are  presently  not  well  organized  to  provide  good  information  on 
a  particular  type  of  cost.  For  instance,  until  very  recently,  certain 
research  and  development  cost  elements  were  so  characterized.  By 
contrast  in  other  instances,  the  analyst  nay  find  that  the  basic  raw 
data  are  readily  available  from  some  accessible  industry  or  government 
source,  but  that  no  one  previously  had  a  need  to  extract  or  integrate 
them. 

5. 5  Covariance  Between  Elements 

The  greater  the  degree  of  covariance  between  two  elements,  the  more 
likely  is  it  to  pay  to  research  the  costs  of  those  elements.  This 
presents  another  reason  for  thoroughly  researching  prime  adasion  equip¬ 
ment  costa  aince  frequently  certain  other  important  costs  are  calculated 
as  par  cents  of  initial  investment  mission  equipment  costs,  i.e.,  initial 
and  follow-on  equipment  spares,  ACE,  data  (manuals,  etc.).  Hence,  the 
more  we  can  reduce  uncertainty  relative  to  prime  adasion  equipment,  the 
more  we  will  reduce  uncertainty  relative  to  spares,  AGE,  annuals,  etc.* 
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5.6  Establishing  Levels  of  Aggrataelon 

One  particular  aspect  of  tha  tioa  allocation  problea  deserves  special 
eonsidaratlon,  naaaly,  the  level  of  aggregation  at  which  each  aajor  type 
of  cost  will  be  estiaated.  In  other  words,  the  analyst  eaust  decide  how 
deeply  ha  will  probe  into  lower  level  or  sub-elemsnt  costs  for  each  aajor 
eleaant  of  cost. 

This  level  of  aggregation  decision  is  relevant  to  the  tiae  allocation 
problea  for  two  reasons:  generally,  the  deeper  the  analyst  explores  subi  I 
eleaant  costs: 

a.  the  greater  the  tiae  he  will  require  to  coaq>lete  the 
estiaate, 

b.  tha  clearer,  aore  accurate  picture  will  he  get  of  the 
next  higher  aggregation  of  that  particular  kind  of 

it 

cost.  In  other  words,  a  study  of  ainor  eleaent  costs 

is  one  aaans  of  firming  up  an  estiaate  of  aajor  ele- 

aent  costs.  i 

r. 

This  level-of -aggregation  issue  is  iaportant  in  costing  adlitary 
systeaa  because  it  suggests  a  possible  difference  in  the  aethodolcgy  of 
costing  developments  withir  the  state-of-the-art  vs.  those  beyond  the 
state-of-the-art. 

All  future  estimating,  including  cost  estimating,  is  done  by  analogy. 
In  other  words,  the  only  way  to  cost  something  new  is  to  relate  soaa  of 
its  major  characteristics  to  similar  previous  experiences  on  which  a 
store  of  knowledge  has  been  accuamlated. 
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An  essential  difference  in  costing  a  development  within  the  st’te- 
of-the-art  and  one  beyond  the  stat«  -cf-the-art  is  «n  the  level  of  detail 
at  which  the  estimating  relationships  or  analogies  should  be  sought. 

When  the  objective  is  to  estimate  tne  cost  of  an  element  involving  a 
technology  within  the  state-of-the-art,  one  can  find  comparable  performance- 
design-resource-cost  relationships,  based  on  historical  or  projected 
analogies,  at  a  relatively  high  level  of  aggregation.  In  other  words, 
when  a  requirement  is  within  the  state-of-the-art,  it  is  normally 
possible  to  estimate  its  cost  relatively  readily  by  drawing  upon  t 
reservoir  of  official  and  unofficial  planning  and  cost  estimating 
relationships  that  relate  performance  to  design  to  cost,  thus  obviating 
the  need  to  examine  the  specific  lower  levol  resource  inputs  needed  to 
attain  this  apability. 

On  the  other  hand,  by  definition,  such  high-level-analogies  are 
lacking  wht.  the  objective  is  to  cost  a  tecnnological  advancement 
beyond  the  current  state-of-the-art.  The  historical  relationships 
established  for  lesser  performance  capabilities  cannot  be  assumed  to 
apply  to  a  new  and  greater  performance  capability.  However,  as  dis¬ 
cussed  in  Chapter  3.4.3.,  technological  advancements  in  substantial 
treasure  require  new  combinations  of  established  techniques  at  the 
subsystem,  subassembly  and  component  levels.  Therefore,  the  costing 
of  technological  advancements  can  be  approached  systematically  by 
locating  and  consolidating  analogies  or  estimating  relationships  at 
lower  levels  of  aggregation. 

To  generalize,  whereas  it  is  relatively  safe  to  abridge  the  per¬ 
formance-design-resource-cost  translation  when  costing  an  eleaent 

involving  state-of-the-art  technologies,  the  more  advanced  beyond 
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current  technologic*  Is  s  new  system  element,  the  more  it  behooves  the 
cost  analyst  to  Inquire  into  the  specific  resource  laqplicatlons  of  the 
new  requirement. 

A  hypothetical  example  will  Illustrate  the  above  point.  In  this 
example  the  relative  sophistication  of  a  computer  technology  is  indicated 
by  the  symbol  X^,  X^,  X^,  X^,  ly  ...  Xn,  where  X^  is  more  sophisticated 
than  X^.  It  la  assusmd  that  current  technology  has  produced  computers 
with  capabilities  of  X^,  X^  and  X^  and  that  reliable  data  indicate  that 
annual  maintenance  costs  for  each  of  these  machines  approximate  between 
101  and  151  of  their  initial  Investment  costs.  In  this  case  if  the 
objective  is  to  estiaute  the  annual  maintenance  cost  of  a  machine  with 
capabilities,  it  would  be  presumptions,  but  not  rash,  to  use  a 
factor  of  10-151  without  examining  in  detail  what  would  actually  be 
Involved  in  the  way  of  men  and  materials  to  malrtain  X^.  On  the  other 
hand,  it  would  be  fool -hardy  to  estimate  the  annual  maintenance  cost 
of  a  computer  with  X^  capabilities,  without  inquiring  into  the  fullest 
detail  that  available  time  and  data  permit  relative  to  the  types  and 
quantities  of  resources  Jiat  would  be  required  to  maintain  the  X^ 

computer. 

» 

More  concrete  examples  drawn  from  actual  costing  studies  could  also 
be  cited  to  illustrate  the  point.  For  instance,  for  purposes  of  advanced 
systems  costing,  to  estimate  the  cost  of  housing  and  provisioning  a 
complement  of  military  personnel  in  conventional  quarters  at  a  new  base, 
it  is  normally  Justifiable  to  use  a  very  highly  aggregated  CER  of  $X  per 
man  without  identifying  in  detail  the  specific  accomodations  they  will 

need.  Or  in  costing  a  new  command  and  control  system  which  involves  the 
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of  HC-13S  airplanes  as  an  airborne  command  post.  It  smy  be  quit* 
acceptable  to  use  an  official  Air  Force  factor  of  $Y  per  flying  hour 
••timate  the  annual  maintenance  costa  of  servicing  these  planes. 

On  the  other  hand,  co  estimate  the  cost  of  provisioning  a  similar 
complement  of  military  personnel  on  a  Moon  Base  would  require  a  much 
greater  detailing  of  the  specific  accomodations  that  they  would  need. 

to  estiaute  the  annual  maintenance  cost  of  the  spacecraft  to  fly 
them  there  would  require  a  relatively  close  inquiry  into  the  specific 
types  and  quantities  of  resources  to  perform  such  smlntenance. 

The  practical  importance  of  this  level-of-aggregation  principal  is 
twofold.  One,  to  achieve  *  given  degree  of  accuracy,  technological 
advancements  lying  beyond  die  current  state  of  the  art  must  be  costed 
at  a  lower  level  of  aggregation  than  those  lying  within  the  state-of-the- 
art.  Tuo,  if  a  particular  project  requires  costing  a  significant  technological 
advancement  and  if  it  is  very  important  to  minimise  the  uncertainty 
surrounding  the  cost  of  this  element,  the  way  to  do  so  is  to  seek 
estisttting  relationships  at  the  subsystem,  subassembly,  and  major  component 
level. 

Frequently,  of  course,  the  analyst  cannot  get  such  lower-level  detail; 

it  is  often  hard  to  identify  such  lower-level  analogies.  When  he  is  faced 

with  this  contingency,  the  analyst  should  realistically  face  up  to  the 

fact  that  his  estimate  substantially  must  be  a  guess,  and,  like  most 

guesses,  unless  he  is  lucky,  he  is  very  liable  to  be  seriously  wrong.  For 

when  he  cannot  identify  lower- level  analogies,  his  sole  recourse  is  to 

take  performance- to-cost  relationships  for  a  state-of-the-art  technology 

and  intuitively  extrapolate  them  to  cover  beyond- the -state-of-the-art 

technology.  Besides  being  subject  to  serious  error,  this  process, 
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because  it  1*  so  basically  Implicit,  suffers  froa  the  shortcoming  that 
tha  analyst  finds  It  vary  hard  to  laarn  althar  froa  his  good  guesses  or 
bad  on* a. 

5.7 

Before  he  Invests  substantial  tlae  In  collecting  and  analysing  data 
for  each  of  the  various  cost  eleaents  In  his  total  cost  structure,  the 
coat  analyst  should  sake  s  preliminary  survey  with  the  objective  of 
securing  "rough-cut"  or  approxiaate  type  Inforsatlon  on  die  following: 

a.  The  relative  aagnltude  of  die  various  eleaents.  More 
tlae  should  noraally  be  spent  In  researching  anticipated 
large  cost  eleaents  than  saell  cost  elesants. 

b.  The  potential  variation  of  the  various  eleaents.  The 
larger  the  potential  variation,  the  greater  the  aaount 
of  tlae  that  should  be  spent  in  researching  the  eleeant. 

This  variation  asy  be  of  two  types:  one,  the  cost 
sensitivity  type  in  which  total  eystea  cost  Is  related 
to  changes  in  the  value  of  key  perforasnee  or  design 
characteristics;  two,  the  potential  dispersion  in  an 
eleaent's  cost  due  to  uncertainty, 

c.  The  potential  research  pay-off.  The  aore  tractable  the 
uncertainty  problea  is  to  research  and  inquiry  -  the 
aore  proalsing  it  appears  that  a  given  aaount  of  research 
effort  will  fira  up  our  knowledge  of  an  eleaont's  cost  - 
the  aore  justifiable  is  It  to  aake  that  research. 

d.  The  extent  of  covariance  between  several  eleaents.  The 
greater  the  covariance  between  eleaents,  the  aore  likely 
is  it  to  pay  to  thoroughly  research  these  eleaents, 

especially  the  largest  and  independent  variable. 
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A*  a  general  principle,  Co  achieve  a  given  standard  of  accuracy, 
technological  developments  lying  beyond  the  current  state-of-the-art 
should  be  costed  at  a  lower  level  of  aggregation  than  those  lying  vithin 
the  current  state-of-the-art. 


•3 
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4he  —the— tics  for  expllclty  taking  each  of  the  above  criteria  (5.2  - 
3.5)  into  account  in  Baking  an  eatlaate  has  been  worked  out  by  J.  R. 
Miller  of  the  MITRE  staff.  In  addition  an  operating  computer  program 
to  lapis— nt  the  —the— tics  has  been  written.  The  entire  technique 
will  be  incorporated  into  a  Fb.  D.  thesis  now  under  preparation  at  the 
Maesachusetts  Inatltute  of  Technology. 


CHAPTER  6 


SELECTING  AND  COLLECTING  COST  LATA 


6.1  Shortcomings  of  Available  Data 

6.1.1  Ceneral 

Chapter  3  emphasized  how  very  important  it  is  to  accurate  system  cost 

I 

estimating  to  identify  accurately  the  types  and  quantities  of  resources  to 
be  costed.  The  second  requisite  to.  accurate  systjwi  cost  estimating  is  to 
accurately  determine  the  prices  per  unit  to  be  used  in  costing  each  of  these 
resources. 

Since  all  future  costs  are  estimated  via  analogy  to  some  previous  cost 
experience  or  projection,  a  major  task  confronting  the  estimator  la  to 
decide  where  to  look  for  the  most  appropriate  analogies.  Accordingly,  one 
of  the  most  Important  functions  of  system  cost  methodology  is  to  guide  the 
estimator  in  seeking  such  analogies  --  to  provide  ground  rules  relative  to 
cost  data  inputs  for  the  new  estimates.  i 

The  decision  relative  to  cost  data  inputs  is  difficult  for  at  least 
three  reasons: 

a.  Until  recently  there  has  been  a  general  shortage  of  historical 
data  with  a  system  orientation. 

b.  Available  data  have  frequently  been  of  questionable  validity  and 
of  doubtful  co«4>arabillty  over  time. 

c.  Available  data  have  frequently  been  of  limited  relevance  to  future 
cost  estimating  because  the  technological  requirements  of  new 
systems  have  often  differed  markedly  from  those  of  past  systems; 
that  is,  the  past  and  future  systesui  have  not  been  completely 
analogous. 
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6.1.2  Scarcity  of  Data 

First,  military  systma  coating,  as  a  relatively  new  discipline,  has 
suffered  from  a  general  shortage  of  historical  data.  Although  the  ailitary 
services  and  industrial  contractors  have  maintained  cooperatively  detailed 
financial  and  related  records  on  ailitary  contracts  for  many  years, 
relatively  few  of  these  voluminous  data,  until  recently,  have  been 
classified  on  a  system  basis.  One  reason  for  this  is  that  in  some  areas, 
like  complex  military  electronic  systems  and  space  systems,  the  systems  have 
been  relatively  few  in  number  and  relatively  recent  in  origin.  Since  these 
systmu  take  five  to  ten  years  to  run  their  course,  system  cost  analysts 
have  frequently  been  obliged  to  estimate  the  cost  of  an  important  element 
of  a  new  system  on  the  basis  of  only  one,  two,  or  several  more  or  less 
analogous  cost  experiences  in  the  past. 

6.1.3  Qualitative  Shortcomings 

Second,  available  data  have  suffered  from  serious  qualitative  short- 
comings.  In  this  initial  period  government  and  industrial  cost  reports  and 
accounting  records  have  been  in  the  process  of  development;  and  only  recently 
has  the  pattern  of  a  comprehensive,  standardized  reporting  procedure  begun 
to  emerge.  Therefore,  for  many  of  the  systems  introduced  five  to  ten  years 
ago  the  cost  records  are  in  some  important  particulars  lacking,  in  others 
Incomplete  or  incomprehensible,  and  in  most  cases  of  limited  comparability 
with  the  records  of  more  recent  systems. 

A  somewhat  related  problem  is  that  many  cost  reports  have  not  been 
properly  structured  to  provide  the  kinds  of  data  needed  for  advanced  system 
cost  analysis.  This  has  happened  beca  e  these  reports  have  been  designed 
primarily  to  serve  other  purposes  such  as  monitoring  contractor  performance 


on  current  contracts. 
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6.1.4  Relevancy  Problem 

Third,  available  data  often  have  provided  a  dubious  future  estimating 
base  because  the  performance  and  design  characteristics  of  net*  systeas  have 
soaietimcs  differed  aarkcdly  froai  those  systeas  for  which  an  adequate  and 
valid  cost  data  base  has  exirted.  Thus,  even  staple  and  reliable  data  on 
a  past  systea  having  2  level  survivability,  having  a  coaputer  with  a  Y 
data  processing  rate,  and  an  airborne  vehicle  capable  of  2  speed  are  of 
limited  usefulness  in  costing  a  future  systea  requiring  a  52  level  of 
survivability,  «  coaputer  with  a  10Y  data  processing  rate,  and  an  airborne 
vehicle  capable  of  32  speed. 

6.2  Using  Available  Data  to  Rest  Advantage 

6.2.1  Heed  for  Multiple  Inputs 

For  two  reasons  the  cost  analyst  should  explore  widely  in  seeking 
analogous  cost  experiences  as  a  base  for  his  future  cost  estiaiates.  First, 
if  the  cost  analyst  relies  on  one  or  two  observations  as  his  est  luting 
base,  he  will  find  it  extreaely  difficult  to  determine  whether  these 
observations  provide  a  representative  sample.  If  they  are  not  representative 
he  ru-s  a  risk  of  serirus  error  if  be  uses  them  as  a  future  estimating  base. 
In  other  words,  normally  no  single  prior  experience  or  projection  should 
be  taken  as  1001  applicable  to  a  new  costing  situation.  Even  in  cases  in 
which  the  future  element  configuration  completely  corresponds  to  some  past 
configuration,  it  does  not  mean  that,  ipso  facto,  the  future  costs  will 
correspond  exactly  to  the  past.  As  a  bare  minimum,  the  future  situation 
should  be  examined  for  such  possibilities  as  price  level  changes  or  learning 
curve  phenomena.  If  different  industrial  contractors  may  be  used  in  the 
future,  different  pricing  policies  and  productivity  coefficients  should  be 


allowed  for.  Aren  the  same  contractor  from  one  period  to  the  next  may 
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change  hit  pricing  philosophy.  Similarly,  in  the  reala  of  ailitary  costs, 
such  factors  as  ailitary  pay  and  allowances  are  subject  to  Congressional 
aaendaent ,  and  staffing  patterns  for  performing  certain  jobs  aay  change. 

6.2.2  Analogies  at  the  Element  Level 

Just  as  no  single  historical  datua  is  cooqiietely  relevant  and  sufficient 
for  costing  a  new  requirement,  siailarly  great  aasses  of  data  aight  be 
adaitted  on  a  Halted  relevancy  basis.  Practically,  this  aeans  that  in 
seeking  cost  analogies  the  cost  analyst  can  profitably  look  beyond  the  one 
or  several  prior  systeas  whose  end  aissions,  general  requirements,  and 
general  configurations  aost  closely  reses&le  those  of  the  new  systea  he  is 
costing.  It  aust  be  reaeabered  that  the  costs  of  large,  cooplex  ailitary 
systesw  are  usually  estimated  by  summing  the  costs  of  their  nuaerous  con¬ 
stituent  elements.  And  great  similarities  will  often  be  found  in  the  con¬ 
stituent  eleaents  at  the  subsystem,  major  function,  and  aajor  component 
level  among  systeas  iriiich  differ  substantially  in  tents  of  their  end 
aissions,  general  requireaents,  and  general  configurations. 

The  logic  of  seeking  broadly  for  relevant  analogies  at  the  cost 
element  level  could  be  illustrated  by  msny  examples.  A  few  will  be  cited. 

a.  The  cost  of  transporting  a  ailitary  officer  overseas  is  likely 
to  average  $750  per  saa  whether  that  officer  is  to  be  attached 

to  a  weapons  systea  or  a  coanand  and  control  systea.  (In  practice, 
this  cost  is  likely  to  vary  greatly  froa  situation  to  situation. 

The  determining  faetbrs,  however,  are  not  the  type  of  systesu  to 
which  a  aan  is  assigned,  but  where  he  is  located  geographically, 
his  rank,  and  whether  he  is  single  or  aarried  with  dependent 
travel  authorised.) 

b.  A  support -service  facility  —  like  a  barracks,  ness  hall  or  general 

administration  building  —  will  normally  in  a  given  environment 
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entail  similar  coats  whatever  the  type  of  system  in  which  it  is 
employed. 

c.  The  costs  of  suintaining  a  given  off-the-shelf  computer  should 
be  siailar  whether  the  computer  is  used  in  a  command  and  -ontrol 
systea*  a  weapon  systea;  an  Army,  Navy,  Air  Force  or  NASA  systea. 

d.  The  hourly  operating  and  aaintenance  costs  of  a  C-13S  airplane 
are  likely  to  be  siailar  whether  the  plane  is  used  for  transport 
purposes  or  as  an  airborne  coouand  post. 

Kecapitulating,  rather  than  seeking  to  pinpoint  the  one  aost  closely 
analogous  prior  observation,  the  cost  analyst  should  aim  for  multiple 
inputs  of  various  relevancies  and  should  consider  each  of  these  observations 
in  reaching  his  estimate  of  the  cost  of  the  new  element. 

However,  if  he  is  to  carry  out  this  prescription  effectively,  the 
cost  analyst  must  take  account  of  two  other  considerations.  One,  if  he  is 
to  consider  multiple  data  inputs,  he  must  have  a  method  for  evaluating 
and  weighting  each  of  these  Inputs  in  terms  of  its  applicability  to  the 
new  cost  estimate.  Chapter  7  of  thle  paper  will  discuss  this  issue. 

Second,  in  separately  considering  various  sources  of  historical  and 
projected  data  as  potentially  pertinent  or  analogous  to  the  new  cost 
estimate  that  he  has  to  make,  the  coat  analyst  must  balance  the  expected 
payoff  of  such  research  against  the  man  hours  required  to  do  that  research. 
In  the  last  analysis,  the  cost  analyst  must  rely  substantially  on  his 
Judgment  and  experience  in  deciding  to  explore  one  potential  source  of 
data  as  opposed  to  another.  However,  the  type  of  criteria  advanced  in 
Chapter  S  for  allocating  research  time  should  help  him  in  formulating  and 
verifying  his  judgments. 


89 


6.3  Us  in*  Expert  Opinion  As  A  Data  Soured 


Concurrently  with  his  efforts  to  increase  the  number  of  data  inputs 
at  his  disposal,  the  cost  analyst  should  strive  to  include  more  reliable 
and  relevant  types  and  sources  of  data  in  the  base  for  his  future  cost 

estiswtes. 

. 

6.3.1  Improvements  in  Reporting 

1 

Hew  cost  reporting  procedures  established  in  recent  years  by  the 

i 

Department  of  Defense  and  the  Air  Force  have  improved  both  the  clarity 

' 

and  completeness  of  the  formal  system  cost  base  available  to  the  analyst. 

i 

Squally  important,  these  new  procedures  have  fostered  a  greater  comparability 
of  historical  cost  data  frjm  one  time  period  to  another  and  from  one  program 
element  (system)  to  another.  One  result  of  this  trend  toward  standardisation 
has  been  to  facilitate  the  search  for  cost-estimating  relationships  pertinent 


to  a  new  estimate. 


6.3.2  Katlonale  for  Subjective  Inputs 

To  furthep  improve  the  relevancy  of  the  data  inputs  which  he  uses  as 
a  base  for  estimating  the  costs  of  future  systems,  the  cost  analyst 
increasingly  must  go  beyond  the  field  of  objective,  historical  statistics 
to  include  among  his  data  inputs  a  whole  range  of  subjective  projections. 

He  should  do  this  because  these  subjective  data  sources,  such  as  previous 
advanced  planning  cost  estimates  of  other  new  systems,  still  under  develop¬ 
ment,  and  the  expert  opinions  of  specialists  in  various  equipment  and 
subsystem  aroas,  frequently  can  provide  a  more  relevant  basis  for  costing 
the  advanced  technologies  of  new  systems  than  can  the  historical  statistics 
covering  the  costs  of  older  technologies  and  systems. 

This  recourse  to  projections  or  expert  opinions  as  a  base  for  deriving 

other  projections,  estimates,  and  opinions  is  nothing  new.  In  recent 
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years  Bayesian  statistics  with  its  emphasis  on  subjective  probability  has 
gained  touch  support.  And,  of  course,  the  businessman  and  market  analyst 
have  traditionally  followed  this  principle  in  forecasting  the  future  sales 
of  a  company's  products.  That  is,  in  forecasting  the  sales  of  his  company's 
product,  a  market  analyst  will  not  only  consider  the  objective,  historical 

records  of  the  company's  past  years'  sales.  He  will  also  give  fcsportant 

( 

weight  to  the  separate  opinions  of  top-ranking  economists  as  to  what  the 
gross  national  product  will  be  in  the  subsequent  year,  and  also  to  the 
opinions  of  the  company's  marketing  and  production  specialists  relative 
to  the  projected  competitive  position  of  the  company  in  the  industry  in 
which  it  operates. 

6.3.3  Methodological  Problems 

The  methodology  cf  using  expert  opinions  and  other  subjective  pro¬ 
jections  as  data  inputs  to  future  cost  estimating  is  largely  undeveloped. 
Hence,  the  coonents  on  this  subject  in  this  document  will  be  suggestive 
only. 

for  one  thing,  it  is  pertinent  to  note  that  the  problems  of  the  system 
cost  analyst  in  handling  these  types  of  inputs  are  methodologically  quite 
similar  to  those  encountered  by  specialists  in  other  disciplines  —  the 
business  decision  maker,  the  economist,  the  market  research  analyst,  the 
sociologist,  the  political  scientist,  and  the  bekavorial  scientist  in 
general . 

Illustrative  of  the  types  of  problems  that  confront  the  analyst  are: 

a.  The  establishing  of  formal  or  informal  criteria  for  selecting 
the  experts  whose  opinions  are  to  be  solicited. 

b.  The  formulating  of  the  precise  question(s)  to  be  put  to  the 


expert(a)  and,  where  multiple  experts  are  involved,  the 
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standardicing  of  the  procedure  for  presenting  the  questions  In 
order  to  minimise  Misinterpretation,  deliberate  bias,  and  other¬ 
wise  non-unlfom  or  unaeaningful  responses, 
tl  ce  the  probleas  of  the  cost  analyst  in  handling  expertise  are 
amthodologlcally  akin  to  the  interview  probleas  faced  in  the  other 
disciplines  references,  these  types  of  probleas  will  not  be  discussed 
here. ^  However,  Chapter  7  will  discuss  a  third,  related  task,  naaely, 
hi**  no  devise  systeaatic  aethods  for  evaluating  the  responses  received 
ixjm  the  various  experts  against  each  other  and  also  for  determining  the 
relevancy  of  each  against  various  historical  data  as  pertinent  to  the  new 
cost  being  estimated. 

6.4  Sources  of  Data 

This  paper  will  review  only  illustratively  the  various  sources  of 
historical  and  projected  cost  data  useful  to  the  system  cost  analyst.  A 
comprehensive  review  and  evaluation  of  specific  official  and  unofficial 
data  sources  will  be  reserved  for  a  subsequent  companion  study  to  the 

i 

present  document. 

Government  and  industry  reporting,  accounting,  and  information  systems 
provide  the  source  of  most  historical  data: 

a.  There  are,  in  the  first  instance,  official  reports  that  industry 
is  required  to  file  with  the  cognizant  military  office  or  that 
lower  echelon  military  offices  file  with  higher  authority.  In 
the  former  group  are  the  Contractor  Cost  Keports  that  all  aajor 
contractors  are  required  to  file  with  the  appropriate  Air  Force 
procurement  office  that,  among  other  things,  summarise  the  cost 
experiences  of  the  company  on  the  designated  contract  during  the 
preceding  year. 
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b.  Over  and  beyond  Che  formal  reports,  baric  accounting  records,  both 
government  and  industry,  provide  conr idcr.rble  unpublished, 
historical  data  that  can  be  tapped  during  the  course  of  personal 
visits  to  the  respective  office,  provided  clearance  for  access 

to  this  material  can  be  arranged. 

c.  Additionally,  special  historical  studies  on  particular  systems 
are  sometimes  prepared  by  various  offices  of  the  Air  Force,  by 
industrial  firms,  or  by  non-profit  organizations  such  as  RAMD, 
AEROSPACE,  or  MITRE.2 

d.  numerous  official  comp end turns  either  summarize  data  that  appeared 
in  the  official  recurring  reports  or  index  the  various  reports 
that  are  available.  Illustrative  of  the  former  are  the  Air  Force's 
USAF  Planning  Factors  (Peace  Time  and  War  Time),  AFM-172-3  and 
USAF  Statistical  Digest.  SSU -23 .  Also  various  Air  Force  manuals 
susnarize  cost,  design  and  related  information  on  state-of-the- 
art  equipment,  eg..  Military  Handbook.  Electronic  Communication 
Equipment  (4  Volumes),  MIL-HDBK-161 .  An  index  of  Air  Force 
reports  is  provided  by  List  of  Recurring  Reports,  SS-U2S. 

e.  Finally,  numerous  official  and  private  catalogues  plus  private 
information  services  and  trade  journals  contain  a  wealth  of  cost 
and  related  data  covering  particular  systems,  equipments,  and 
state-of-the-art  technology.  In  the  former  category  are  the 
General  Services  Administration's,  Gille's  Associates’,  and  Adams 
Associated  catalogues  on  electronic  data  processing  equipment. 

In  the  latter  category  are  Aviation  Week.  Missiles  and  Rockets. 
Datamation,  etc.  plus  the  Defense  Marketing  Services  (Market 
Intelligence  Reports). 
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Sources  of  projecclons  and  expert  opinions  relative  to  future  or 
pffosfoctive  system  cost  data  are  equally  varied: 

a.  The  Contractor  Cost  fteports  previously  referenced  os  a  useful 
source  of  historical  data  are  similarly  valuable  as  a  source 
of  contractor  estimates  of  the  cost  to  complete  the  contract. 

b.  Prior  to  these  in  the  chain  of  official  documents  in  the  pro¬ 
curement  cycle  are  the  bid  proposal  reports.  One  of  the  advantage* 
of  the  bid  reports  is  that  the.*  provide  a  basis  for  securing  a 
consensus  of  expert  opinion  on  the  cost  of  meeting  a  new  require- 


c.  Once  again,  personal  visits  to  Industry  or  government  offices  can 
■oawtimes  extract  unpublished  details  lying  behind  these  official 
reports. 

d.  Similarly,  experts  working  for  industry,  government,  universities, 
and  not-for-profit  organizations  are  very  well  versed  with 
potential  new  products  and  new  technologies,  and  they  often  can 
give  the  cost  analyst  valuable  opinions  relative  to  the  resource 
Implications  of  future  developments  in  their  specialized  fields. 

e.  The  official  Department  of  Defense  and  Air  Force  reporting 
systems,  such  as  Proposed  System  Package  Programs  (Section  11), 
provide  detailed  cost  estimates  covering  systems  and  programs 
submitted  r.o  higher  echelons  for  approval. 

f.  There  is  an  increasing  number  of  advanced  system  cost  studies 
prepared  by  the  Air  Force,  by  industry  (solicited  or  unsolicited), 
and  by  non-profit  organisations  such  as  SAND,  ASSOSP&CE,  and  MITRE. 

g.  Trade  Journals  and  private  information  services,  as  cited  pre¬ 
viously  'in  this  section,  are  s  source  of  projections  and  expertise 

I 

just  as  they  are  a  source  of  historical  data. 
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6.5  Data  Hast-  Systems 

Practically  all  organizations  that  have  e.iablixhed  system  cost 
analysis  departments  have  found  it  advantageous  to  establish  what  are 
known  as  Data  Base  Systems  or  Data  Banks. 

A  Data  Base  System  is  a  technically  and  administratively  centralised 
system  for  handling  aujor  empirical  functions  associated  with  costing 
military  systems. 

Simply  stated,  the  objective  of  any  Data  Base  System  is  to  provide 
the  cost  analyst  with  both  more  and  better  quality  data  and  to  provide 
this  data  a»re  quickly  than  would  be  possible  without  such  a  system. 

In  practice,  the  degree  of  formality  characterising  the  Data  Base 
Systems  of  existing  system  cost  analysis  organisations  varies  considerably. 
The  major  features  of  the  MITRE  Data  Base  System,  one  of  the  more  formalised 
of  the  existing  systems,  are  the  following: 

,  a.  A  comprehensive  and  consistent  system  for  the  determination  of 
types  of  data  to  be  gathered. 

b.  A  systematic  and  efficient  swans  of  collect ing  and  updating  such 
data. 


c.  An  easy  method  for  the  entry  of  such  data  into  the  Data  Base. 

d.  A  formal  method  of  evaluation,  validation,  categorisation  and 
storage  of  the  data . 

4 

e.  A  quick  means  of  retrieval  for  ultimate  use. 

The  Data  Base  should  properly  serve  not  only  as  a  central  repository 
for  the  collection  and  dissemination  of  the  documented,  historical  portion 
of  system  cost  data,  it  also  can  function  as  the  focal  point  for  identifying 
knowledgeable,  external  sources  of  relevant  information. 

One  of  the  important  practical  consequences  of  a  centralised  Data 
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Base  System  is  Chat  it  tends  to  formalise  end  standardize  the  documentation 
of  departmental  cost  studies.  A  highly  sophisticated  Data  Base  System 
will  require  the  cost  analyst  to  doexment  relatively  specifically  how  he 
arrived  at  his  cost  estiautes,  including  an  identification  of  his  sources 
of  primary  and  f econdary  data,  a  detailing  of  the  statistical  Manipulations 
he  performed  on  these  data,  and  an  explanation  as  to  why  he  selected  these 
data  sources  and  statistical  techniques  as  opposed  to  others.  To  the 
extent  that  it  proantes  these  practices  a  formalized  Data  Base  will  con- 
tribute  to  attaining  the  systematized,  explicit  approach  to  cost  analysis 
advocated  in  Chapter  1.  Accordingly,  a  formalized  Data  Base  System  can  be 
a  most  useful  step  in  securing  the  regular  "feedback"  so  essential  if 
system  cost  analysis  is  tc  become  more  of  a  science  and  less  of  an  art. 

6.6  Cost  Estimating  Belatlonshlga 

6.6.1  Definition  and  Classifications 

Dp  to  this  point  this  chapter  has  discussed  particular  historical 
cost  experiences  or  projections  as  data  inputs  or  analogies  for  estimating 
the  future  cost  of  a  new  system  element.  Chapter  7  will  consider  the 
mechanics  of  melding  these  heterogenous  bits  of  evidence  into  an  estimating 
tool  specifically  tailored  for  calculating  the  future  cost  of  a  particular 
cost  eleawnt  of  a  particular  system. 

t  This  section,  on  the  other  hand,  will  discuss  briefly  the  generalised 
cost  estimating  relationship,  hereafter  referenced  as  a  CSK.  Simply 
defined,  a  CB  is  a  generalized  statistical  distillation  of  multiple  cost 
experiences  covering  a  defined  type  or  area  of  cost.  Frequently,  a 
generalised  CEB  serves  as  one  of  several  or  many  inputs  in  estimating  the 
cost  of  an  element  of  a  particular  system. 
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CP»  may  be  different iated  by  the  type  of  cost  determining  variables, 
aa  follows: 

a.  Coat  related  to  some  physical  resource,  e.g.  —  building  con* 
stniction  cost  ■  $15  per  square  foot. 

b.  One  type  of  cost  related  to  another,  e.g.  —  Annual  Operating 

Cost  (Mission  Equipment)  ■  151  of  Initial  Investment  Cost 

! 

(Mission  Equipment). 

I 

c.  Cost  related  to  some  performance  characteristic,  e.g.  —  Electronic 
Computer  Central  Complex  Initial  Investment  Cost  in  Dollars 

log1()  C  -  6.44  -  0.980  log1()  SCT  +  0.064  log1()  CAT 

I 

where  C  “  Cost  of  central  complex  in  dollars 

SCT  ■  Storage  cycle  time  in  microseconds 

CAT  “  Complete  add  time  in  microseconds 

These  several  basic  types  of  CEKs  may  be  further  differentiated  into 

several  degrees  of  complexity  or  sophistication.  The  simplest  CEls  are 
a 

linear,  proportional  relationships  between  cost  and  one  cost -determining 
variable  such  as  the  building  construction  cost  example  cited  in  the  pre- 
ceding  paragraph.  More  complicated  CE Sts  depict  various  types  of  non-linear 
relationships  between  cost  and  two  or  more  cost -determining  variables  such 

I 

as  the  computer  equipment  CEE  cited  above.  Most  of  the  generalized  Cits 
actually  used  in  costing  military  systems  are  linear -proportional  relation¬ 
ships  between  cost  and  one  cost -determining  variable,  usually  cost  and  some 

j 

physical  resource  or  parameter.  (As  used  here,  the  term  Mphysicaln  resource 
is  broadly  defined  to  include  human  resources  such  as  engineering  ns  hours 
aa  well  as  Inanimate  resources  such  as  buildings  and  equipment.) 

Generally  there  is  a  positive  correlation  between  the  number  of 

observations  and  the  validity  of  the  estimating  relationship,  i.e. ,  the 
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relative  accuracy  with  which  the  atatiatical  estimating  relationship 
actually  measures  the  phenomenon  it  la  depicted  to  measure.  However,  any 
anaher  of  individual  data  point a ,  including  both  objective  (historical) 
and  aubjective  data  inputa  can  be  used  as  the  base  from  which  to  derive  a 
generalised  cost  estimating  relationship.  Again  in  point  of  experience, 

most  generalised  CDs  developed  to  date  and  actually  used  in  military 

•  • 

system  costing  are  based  predominantly,  almost  exclusively,  upon  historical 
experience. 

One  additional  differentiating  characteristic  among  CSSs  should  be 
noted;  namely,  the  level  of  aggregation.  A  large  variety  of  aggregation 
levels  for  a  given  type  of  cost  can  be  developed.  For  instance,  at  a 
high  aggregation  level,  it  may  be  generalised  that  Military  Pay  and 
Allowances  *  $5,000  per  man  per  year  (this  $5,000  per  year  figure  assumes 
a  ratio  of  one  officer  to  five  airmen).  A  step  lower  in  aggregation  would 
be!  Military  Pay  and  Allowances  (Officers)  ■  $10,000  per  man  per  year  and 
Military  Pay  and  Allowances  (Airmer.)  *  $4,000  per  man  per  year.  Still 
lower  aggregation  levels  would  differentiate  both  officers  and  airmen  into 
different  rank,  skill,  geographical  assignment  location,  and  other  such 
cost -determining  categories. 

6.6.2  Advanta  es  of  CHUi 

The  preceding  point  appropriately  leads  to  the  next  question,  the 

advantages  of  using  CE&s.  The  aost  obvious  advantage  of  CBts  is  the 

tremendous  savings  they  cec  provide  in  the  time  required  to  complete  an 

estimate.  In  effect,  a  CEt  makes  it  possible  to  estimate  a  highly 

aggregated  future  cost,  e.g.,  equipment  maintenance  costs,  without  a 

detailed  identification  and  costing  of  each  of  the  specific  resource  inputs 

to  this  future  cost.  The  alternative  to  using  a  CBS  would  be  a  low-level- 
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®*'*gg*«gation  direct  Btsiurnwot  by  which  the  analyst  estivates  a  high-level- 
of -aggregation  future  coat  by  identifying,  tallying,  and  pricing  in  detail 
each  of  the  specific  types  of  resource  inputs  to  a  new  system  element. 

Thus,  the  availability  of  a  generalised  CM  makes  It  possible  in  individual 
coating  studies  to  reduce  greatly  the  time  spent  in  gathering  and  compiling 
data,  In  a  matter  of  hours,  sometimes  even  in  minutes,  by  means  of  a  CCS, 
an  analyst  can  estimate  a  future  cost  that  would  require  days  or  even 
weeks  to  estimate  through  direct  measurement .  Thus  a  direct  measurement 
of  equipment  maintenance  cost  would  have  to  cover  the  replacement  of  equip¬ 
ment,  follow-on  spares,  maintenance  personnel  (military,  government  civilian, 
contractor),  transportation  of  equipment  and  spares,  updating  swlntenance 
manuals.  Additionally,  it  would  be  necessary  to  further  subdivide  the 
above  general  types  of  maintenance  costs  into  types  of  equipment  to  be 
maintained,  types  of  personnel  to  be  employed,  etc. 

Sometimes  a  CER  will  also  provide  a  more  accurate,  reliable  basis  for 
mating  a  future  cost  than  a  direct  sreasurement.  A  well-developed  CER 

f  I  '  ' 

is  derived  from  a  wide-coverage,  carefully  documented,  objective,  after- 
the-fact  analysis  of  representative  available  data.  On  the  other  hand, 
direct  measurements  frequently  are  the  product  of  a  fragmentary , hastily 
compiled  survey  that  fails  to  cover  representatively  and  in  depth  the  cost 
element  being  studied.  It  is  especially  difficult  to  make  adequate  direct 
measurements  of  total  life-cycle  costs  in  the  advanced  planning  stage  of 
a  system's  development  long  before  the  physical  and  operational  character¬ 
istics  of  the  system  have  been  defined  in  detail. 

6.6.3  Limitations  of  CESs 

Are  there  any  shortcomings  or  limitations  in  using  CERs;  when  is  it 
advisable  to  use  a  different  estimating  tool;  and  what  are  such  alternative 


tools? 
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In  the  first  place,  it  is  not  always  possible  to  use  a  CSX  because 
for  certain  types  of  cost,  generalised  CEXs  have  not  yet  been  developed. 

As  an  exanple,  a  shortage  of  usable  data  has  made  it  difficult  to  develop 
reliable  CEXs  for  estimating  research  and  development  costs. *  Similarly, 
difficulty  in  marshaling  available  data  and  the  heterogeneity  of  display 
equipment  have  haapered  efforts  to  develop  good  CQU  for  electronic 
display  equipment . 

Second,  CEXs  have  same  limitations  even  in  cases  in  which  substantial 
effort  has  been  expended  in  developing  relatively  sophisticated  CEXs,  as 
in  the  case  of  electronic  computers.*  For  one  thing,  the  generalized  CEX 
on  computers  covers  many  tmnufacturers'  equipments  and  various  models 
from  each  manufacturer.  It,  thus,  by  definition  depicts  an  average 
relationship.  If  the  analyst  happens  to  be  costing  an  off-the-shelf 
computer  and  he  knows  the  particular  manufacturer  and  model  required,  a 
catalog  price,  such  as  listed  by  the  General  Services  Administration 
catalog,  will  provide  a  more  accurate  estimating  bate  than  would  a 
generalised  CEX. 

Similarly,  when  the  assignment  is  to  estimate  an  element  whose 
technology  lies  beyond  the  state-of-the-art,  a  CEX,  being  based  predominantly 
or  exclusively  on  historical  experience  for  state-of-the-art  equipment . 
loses  som  of  its  relevance. 

6.6.4  When  To  Pse  CEXs 

Acknowledging  the  above  qualifications,  much  can  still  be  said  in 
favor  of  a  generalized  CEX  as  an  input  for  estimating  both  state-of-the- 
art  and  beyond-the-state-of-the-art  elements.  Frequently  when  the  analyst 
has  knowledge  that  a  state-of-the-art  development  is  involved,  he  may  not 

know  the  particular  Mnufacturer  and  sK>del  number  of  equipment  required. 
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This  is  sspecislly  likely  to  happen  .  -  sn  advanced  planning  study.  In 
such  csss t  s  particulsr  catalog  pries  may  be  too  specific  wheress  s 
genersliaed  CEA  by  giving  the  sv crags  or  representstive  price  asy  offer  s 
useful  working  cooproaisc.  As  s  here  minimum,  the  CE3.  would  serve  ss  s 
useful  sense  check  of  sn  estimate  derived  through  cstslog  sources. 

The  esse  for  the  usefulness  of  s  genersliaed  CEA  is  even  no  re 
compelling  when  the  task  is  to  estiaste  the  coat  of  an  el men t  whose 
technology  lies  beyond  the  atate-of -the-art .  In  the  words  of  usvio  Novick, 
the  aore  ’’futuristic"  is  the  requirement ,  the  more  important  it  is  to 
study  history  in  search  of  useful  analogies.^  The  rationale  for  th  .s 
point  of  view  is  stated  by  Simon  Auznets  in  a  somewhat  broader  context. 
Writing  on  the  methodology  of  long-run  economic  projection,  Kuznets  notes 
that  two  conditions  are  always  necessary  to  any  kind  of  projection.  One 
is  that  there  must  be  an  identifiable  relation  between  the  future  and  the 
past.  Two,  there  must  be  a  minimum  of  order  in  the  past  that  can  be  trsns- 

g 

lated  into  some  specific  pattern  for  the  future. 

In  the  case  of  military  system  analysis  when  costing  a  beyond-the- 
atate-of -the-art  requirement,  the  generalized  CEA  provides  the  analyst 
with  a  frame  of  reference,  a  useful  starting  poinc.  The  generalized  CEA, 
if  it  has  been  reliably  derived,  epitomizes  history,  and  if  the  analyst 
rejects  history,  he  is  almost  completely  bereft  of  a  base  from  which  to 
begin.  The  essential  precaution  that  the  analyst  must,  of  course,  observe 
is  that,  when  a  requirement  is  beyond  the  state-of -the-art ,  the  generalized 
CEA  must  be  regarded  as  one  important  data  input  among  several  or  many 
rather  than  the  one  and  only  input  or  estimating  base. 
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Hie  reliability  of  a  completed  system  cost  estimate  is  vitally  dependent 
on  the  validity  and  relevance  of  the  cost  data  inputs  used  to  derive  the 
estimate.  Accordingly,  one  of  the  most  important  functions  of  system  cost 
methodology  is  to  guide  the  cost  analyst  in  selecting  the  appropriate  types 
and  quantities  of  data  he  needs  to  estimate  the  costs  of  his  system. 

One  of  the  reasons  that  system  cost  estismting  has  been  difficult  in 
the  past  is  because  historical  cost  data  classified  on  a  system  basis 
have  frequently  been  sparse,  incomplete  and  non-coaparable  from  system  to 
system  and  from  one  time  period  to  another. 

In  costing  a  new  system  the  cost  analyst  should  draw  upon  as  extensive 
and  as  comprehensive  a  data  base  as  possible  In  seeking  to  expand  his 
data  base  he  should  look  for  analogies  at  the  system  element  level  -- 
subsystems,  suijor  activities,  and  major  components.  He  should  ext  end  his 
search  at  the  element  level  to  incorporate  systems  differing  in  end-mission, 
general  requirements,  and  general  configuration  from  those  of  the  new 
system  he  is  costing. 

The  dynamic  character  of  military  technology  makes  it  irperative  that 
the  cost  analyst  look  beyond  the  realm  of  historical  statistics  to 
incorporate  subjective,  expert  opinion  into  his  cost -estimating  base. 

The  cost  analyst  should  be  eclectic  in  searching  out  specific  data 
sources  for  a  particular  cost  estimate  since  there  are  numerous  official 
and  unofficial,  formal  and  informal,  sources  of  system  cost  data. 

The  generalized  cost  estimating  relationship  (CER)  is  an  invaluable, 
frequently  an  indlspensible,  tool  in  estimating  future  system  costs.  Its 
Min  shortcoming,  like  that  of  other  useful  tools,  is  in  its  indiscriminate 
applications  to  problems  that  it  was  never  intended  to  solve.  More 
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specifically,  the  generalized  CER  is  almost  always  a  useful  input  to  a 
cost  estimating  problem.  On  the  other  hand,  only  infrequently  is  it 
suitable  as  the  sole  input  to  an  estimating  problem. 

▲  centralised  Data  Base  System  can  provide  the  cose  analyst  with 
both  more  and  better  quality  data  and  can  also  provide  this  data  more 
quickly  than  would  be  possible  without  this  system.  As  such,  it  can  be 
an  important  means  of  securing  the  regular  "feedback"  so  essential  if 
system  cost  analysis  is  to  become  more  of  a  science  and  less  of  an  art. 
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A  number  of  standard  texts  discuss  the  methodological  problems  in 
obtaining  and  handling  subjective,  opinion-type  inputs;  e.g., 
Pestinger,  Leon  and  Katz,  Daniel,  lesearch  Methods  in  the 
Behavorial  Sciences.  (.Holdt , Rinehart .  and  Winston,  1953)  and 
Lerner,  Daniel  and  Lassvell,  H.  D. ,  The  Policy  Sciences,  Recent 
Developments  in  Scope  and  Method  (Stanford  University  Press, 
1959),  Chapter  IX,  XI,  XII,  Xill,  XVI. 


:or  instance: 


L.  Hamilton  and  T.  H.  Rider,  Cost  Estimate 
unctions.  The  MITRE  Corporation,  TM-3040. 


"*See:  M.  V.  Jones,  Bidder  Cost  Estismtes  As  A  Data  Base  Source  For 
Advanced  Systems  Costing.  The  MITRE  Corporation,  TM-3538  (1963)J 


A  detailed  description  of  the  MITRE  Data  Base  System  is  contained 
in:  L.  R.  Morris,  "The  Economic  Factors  Data  Base  System,"  The 
MITRE  Corporation,  TM-3645  (June  1963).  Also  see:  L.  R.  Morris, 
"The  Economic  Factors  Library,"  The  MITRE  Corporation,  TM- 3161-1 
(January  1963). 

Srhe  most  systematic  effort  to  develop  CERs  for  costing  RAD  has  been 
done  by  J.  V.  Noah,  Identifying  and  Estimating  RAD  Costs  (RAND, 
RM-3067-PR),  May  1962. 

* 

**CER  studies  on  electronic  computers  have  been  completed  by  the 
following: 

|  E.  I.  Friedland  and  J.  R.  Miller,  III,  A  Search  for  Computed 
JCfilfc  JEatiaRttM  jglaitl2a?hips>  *he  MITRE  Corporation,  W-6595, 
(October  1963). 

E.  I.  Friedland  and  J.  R.  Miller,  III.  Compucer  Cost  Estimating 
Relationships:  User's  Manual .  The  MITRE  Corporation,  W-6596, 
(October  1963). 

L.  B.  Early,  S.  M.  Barro,  M.  A.  Margolis,  Procedures  for 
Estimating  Electronic  Equipment  Costs,  RAND,  RM-3072-PR, 

(May  1963). 

R.  W.  Rector,  Predicting  the  Cost  of  Computing  Equipment  From 
Its  Physical  Characteristics.  SYSTEM  DEVELOPMENT  CORPORATION, 

(31  October  1962). 

U.  S.  Air  Force,  Systems  Commend,  Electronic  Systems  Division, 
Electronic  (Data  Processing)  CER  (21  September  1962).  , 


Op.  cit. ,  p.  j. 

B 

Simon  Kuznets  in  National  Bureau  of  Economic  Research,  Long  Rang 
Economic  Projection.  (Princeton  University  Press,  1954),  p.  11. 


CHAPTER  7 

DERWINC  THE  COST  ESTIMATE 


7.1  Parameters  of  the  Problem 

7.1.1  Objective 

Chapter  6,  being  concerned  with  the  Input  side  of  the  cost-estimating 
process,  stressed  the  advantages  to  be  gained  in  collecting  many  and  varied 
types  of  data. 

Chapter  ?,  on  the  other  hand,  might  appropriately  be  subtitled  "the 
process  of  converting  inputs  into  outputs"  since  the  primary  function  of 
this  chapter  will  be  to  discuss  the  mechanics  of  melding  heterogeneous 
data  inputs  into  an  integrated  estimated  cost  of  a  new  system. 

The  "element"  has  been  selected  as  the  point  of  reference  for  a 
discussion  of  output  methodology  since  a  total  system  is  normally  costed 
in  terms  of  its  constituent  elements.  In  other  words,  this  is  an  instance 
where  the  whole  equals  the  sum  of  its  parts;  if  the  elements  are  properly 
and  accurately  costed,  the  total  system  cost  will  be  correspondingly 
reliable. 

7.1.2  Degree  of  Estimating  Difficulty 

As  pointed  out  previously,  all  elements  cannot  be  costed  with  equal 
simplicity.  The  precision  required  in  the  completed  estimate  and  the  time 
available  to  make  the  estimate  are  both  relevant.  The  greater  the  pre¬ 
cision  required,  the  greater  the  difficulty  of  the  estimating  task.  On 
the  other  hand,  the  greater  the  time  available,  the  less  difficult  is  it, 
generally,  to  achieve  a  given  standard  of  accuracy. 

The  nature  of  the  data  inputs  available  also  influences  the  ease  or 
difficulty  of  the  estimating  ta»k  in  several  ways: 


105 


t 


a.  the  larger  the  number  of  data  inputs  (the  more  ample  is  the 
estimating  base),  the  easier  is  the  estimating  task.  In  other 
words,  it  is  normally  easier  to  estisuite  from  large  data  samples 
than  from  small  ones. 

b.  The  more  diverse  is  the  estimating  base,  the  more  difficult  is 
it  to  meld  the  various  inputs  into  an  integrated  estisuite.  For 
instance,  it  is  normally  more  difficult  to  integrate  a  historical 
CD  with  two  informed  opinions  than  it  is  to  integrate  three 
similar,  historical  experiences. 

c.  The  presumed  validity  of  the  estimating  base  is  also  pertinent. 
The  more  accurately  the  available  data  measures  the  phenomena 
they  are  intended  to  measure,  the  more  certainty  with  which  these 
inputs  can  be  used  as  a  future  estimating  base. 

d.  The  presumed  relevance  of  the  estimating  base  is  similarly  very 
important.  The  more  closely  the  performance  and  physical 
characteristics  of  the  new  element  resembles  the  performance  and 
physical  characteristics  of  the  elements  in  the  estimating  base, 
the  easier  is  it  to  make  a  future  estimate. 

7.1.3  A  Single  Data  Input 

If  there  is  only  one  data  input  —  if  same  past  experience  is  con¬ 
sidered  to  represent  a  true  and  complete  analog  of  the  future  element 
being  costed  —  the  estimating  procedure  is  comparatively  simple.  In 
essence  it  involves  a  bookkeeping  transaction  in  which  the  historical  or 
projected  cost  is  located  and  transposed  in  a  catalogue  fashion  as  the 
cost  of  the  future  element. 

Relatively  frequently  a  single  data  input  is  used  as  the  analogue 

for  estimating  the  future  cost  of  an  element  of  a  new  system.  The  most 
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notable  Instance  of  this  practice  is  the  use  of  a  generalised  CSt,  e.g., 
overseas  travel  “  $750  per  man  transported.  If  the  cost  element  represents 


a  small  percentage  of  the  total  system  cost,  and  available  evidence 
Indicates  that  the  cost  of  the  particular  system  for  this  area  of  cost 
will  parallel  the  generalized  past  experience,  such  a  practice  is 
legitimate. 

7.1.4  Multiple  Data  Inputs 

However,  in  many  other  cases  the  analyst  must  resort  to  multiple 
data  inputs  because:  (l)  no  generalized  CER  has  been  developed,  (2)  the 
future  cost  of  the  new  system  or  element  is  expected  to  differ  importantly 
from  the  generalized  past  experience,  usually  because  it  is  functionally 
or  physically  different  from  any  previous  system  or  elearait,  (3)  and/or  the 
item  of  cost  is  sufficiently  large  and  its  impact  on  the  total  system  cost 
sufficiently  great  that  the  analyst  feels  obliged  to  secure  cost  inputs 
expressly  tailored  to  fit  the  new  requirement. 

As  soon  as  there  are  two  or  more  data  inputs  to  a  new  estimate,  a 
problem  of  weighting  develops.  In  a  typical,  relatively  simple  case,  if 
there  are  two  current  systems  (A  and  B)  whose  annual  operating  equipment 
maintenance  costa  are  regarded  as  being  somewhat  analogous  to  the  anticipated 
equipment  smintenance  costs  of  a  new  system  (C) ,  a  decision  must  be  made 
on  the  proportionate  weight  to  be  given  to  the  A  and  B  experiences, 
respectively,  in  arriving  at  the  maintenance  cost  estimate  for  system  C. 

Many  cost  estimating  problems  are  much  sure  complex,  especially  if 
the  eclectic  view  of  data  relevance  recommended  in  Chapter  6  is  adopted. 

This  point  can  be  illustrated  in  terms  of  a  hypothetical  requirement  to 
estimte  the  annual  maintenance  cost  of  a  new  type  of  computer  that  h a* 

many  Qf  the  performance  and  design  characteristics  of  numerous  former , 
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present-day,  end  projected  computers.  In  this  esse,  date  inputs  relstive 
to  computer  asintensnee  costs  could  be  extracted  or  acquired  froa  govern - 
aent  and  private  historical  records,  froa  contractor  projections  associated 
with  new  systeas  under  developaent,  froa  bid  proposal  (source  selection) 
cost  estiaates  on  other  advanced  systeas,  froa  the  "guesstimates"  of  few 
or  aany  industry,  non-profit,  and  government  "experts",  etc.  If  an 
aggressive  effort  were  aade,  it  would  be  easy  to  compile  literally  dozens 
of  historical  and  projected  data  points. 

7 *2  Elements  of  a  Solution 

7.2.1  The  Basic  Choice 

As  indicated  above,  there  is  no  avoiding  the  weighting  decision  when 
there  are  multiple  data  inputs  to  a  cost  estimate.  The  analyst  essentially 
has  two  basic  alternatives.  Either  he  does  the  weighting  explicity  or  he 
does  it  implicitly.  His  only  choice  is  on  the  formality  and  rigor  he 
applies  to  the  task,  including  the  documentation.  A  decision  to  ignore 
the  problea  and  to  weight  every  observation  equally  involves  as  compelling 
if  decision  on  the  latter  of  input  weighting  as  though  days  or  weeks  were 
spent  in  devising  an  elaborate  technique  for  asking  an  explicit,  methodical 
weighting. 

The  basic  aethodo logical  issue  drawn  in  Chapter  1  between  an  implicit 
approach  vs.  an  explicit  approach  is  nowhere  wore  sharply  focused  than  on 
this  matter  of  input  freighting.  As  discussed  in  Chapter  1,  the  primary 
reason  why  implicit  methodology  is  undesirable  is  that  when  the  analyst 
uses  implicit  methods  to  derive  his  cost  estiaate  he  foregoes  the  opportunity 
both  for  an  immediate  check  of  his  estimating  rationale  with  other  analysts 
while  the  estiaate  is  being  derived  and  for  subsequent  empirical  verification 

(feedback).  An  explicit  procedure,  on  the  other  hand,  discourages  caprice 
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•  In  estimating  costs  and  it  provides  the  analyst  with  the  opportunity  both 
to  profit  by  his  mistakes  and  to  benefit  from  his  good  insights. 

7.2.2  Kindred  Disciplines 

tystms  cost  methodologists  have  rarely,  if  ever,  discussed  this 
SMtter  of  input-data  weighting  in  any  formal  sense.  However,  in  several 
kindred  areas  military  decision  makers  have  encountered  the  need  to  devise 
relatively  methodical  (impersonal)  weighting  schemes  for  handling  important 
practical  problems. 

Four  instances  may  be  cited: 

a.  Cost /effective  analysis  is  one  of  the  important  new  tools  diet 
has  been  developed  in  recent  years  to  lend  more  system  and  science 
to  the  process  of  choosing  among  alternative  military  systems  and 
system  configurations.  However,  one  of  the  major  tasks  involved 
in  the  use  of  this  technique  "is  in  devising  criteria  for  defining, 
evaluating,  and  weighting  one  kind  or  attribute  of  system  per¬ 
formance  or  effectiveness  against  another.^ 

b.  Policy  and  operating  levels  of  the  Defense  Establishment,  both 

as  high  and  low  echelons,  are  constantly  striving  to  impart  greater 
objectivity  to  the  Source  Selection  process  of  choosing  military 
contractors.  A  major  aspect  of  the  research  in  this  area  is  in 
finding  more  objective  (con-personal)  means  of  evaluating  and 
weighting  one  bidder's  qualifications  against  another. 

c.  The  Department  of  Defense  is  in  the  process  of  establishing  a 
Contractor  Performance  Evaluation  System.  This  system  seeks  to 
rate  objectively  (impersonally)  a  contractor's  success  in  meeting 
the  performance,  cost,  and  schedule  provisions  of  his  contract. 
However,  requirements  in  each  of  these  areas  sre  multi-dimensional , 
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and  one  of  the  objectives  of  the  CPE  program  is  to  provide  an 

explicit,  systematic  methodology  for  weighting  performance  in 

3 

each  of  its  constituent  phases. 

d.  The  Department  of  Defense  has  been  seeking  more  explicitly  non- 
personal  criteria  for  determining  contractor  profit  objectives 
on  military  contracts.  To  provide  for  a  more  uniform  inter¬ 
pretation  of  the  Armed  Services  Procurement  Kegulations  (ASPS) 
by  military  procurement  personnel,  the  Department  of  Defense  has 
developed  a  "Weighted  Guideline  System" .  This  new  system  seeks 
to  spell  out  explicitly  appropriate  profit  criteria  and  to  provide 
weighting  to  be  applied  to  these  criteria  under  different 
circu^c.4 

The  task  of  devising  scheaws  for  explicitly  weighting  the  data  inputs 
to  a  system  cost  estimste  is,  in  some  respects,  methodologically  similar 
to  the  task  of  devising  weighting  schemes  for  the  other  military  decision 
areas  referenced  above.  Since  system  cost  methodologists,  themselves, 
have  not  yet  established  a  data  input  weighting  scheme,  they  would  probably 
stand  to  benefit  if  they  were  to  become  familiar  with  both  the  problems 
and  the  approaches  to  weighting  devised  in  these  somewhat  kindred  disciplines. 
7.3  Illustrative  Weighting  Format 

7.3.1  The  Advantages  of  Simplicity 

There  are  two  operations  associated  with  establishing  a  data-input 
weighting  scheme.  One  is  to  establish  criteria  for  assigning  weights  to 
various  cost  inputs.  The  other  1s  to  devise  formats  or  sisdlar  tools  for 
presenting  die  weights.  The  latter  task  will  be  discussed  first. 

Although  weighting  schemes  in  general  can  be  ssdc  quite  complex, 
there  are  advantages  in  this  case  in  keeping  them  as  simple  as  possible. 
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considering  the  time  constrsints  thst  the  cost  analyst  is  usually  confronted 
vith  and  the  difficulties  in  collecting  .relevant  data.  The  highly  uncertain 
nature  of  the  input  data,  themselves,  would  belle  a  highly  refined  taechenics 
for  processing  these  data. 

7.3.2  Examples 

The  following  hypothetical  example  perhaps  typifies  the  simplest  type 
of  weighting  format: 

Objective:  To  establish  *a  basis  for  estimating  the  annual  maintenance 

i 

costs  of  the  mission  equipment  of  a  new  system  X. 

Conditions-  (1)  The  cost  is  to  be  expressed  as  a  percentage  of  the 
initial  investment  mission  equipment  costs  of  system  X. 

(2i  There  are  five  cost  4ata  inputs  to  this  estimate; 
namely,  the  historical  annual  mission  equipment  maintenance  costs  of 

t 

systems  A,  B,  C,  D.  and  E.  These  historical  costs  have  each  been  converted 
to  a  percentage  of  initial  investment  costs.  j 

The  advantage  of  a  relatively  simple  format  like  the  following  is 
that  it  provides  at  least  a  start  on  a  scheme  for  arriving  systematically 
at  a  coat  estimate.  Such  a  format  removes  at  least  a  part  of  the  mystery 
associated  with  purely  implicit  methods  of  converting  coat  inputs  into 
coat  outputs.  The  format  provides  a  partial  answer  to  the  question  as  to 
how  the  analyst  reached  his  conclusions;  and  in  so  doing,  it  furnishes  f 
basis  for  further  inquiry.  i 

7.4  Weighting  Criteria 


7.4.1  Seeking  Objectivity 

Of  course,  at  very  best,  such  a  format  is  only  a  start  on  an  objective 

weighting  scheme.  Two  critical  questions  remain  to  be  answered;  namely, 

to  take  the  first  example,  how  did  the  analyst  decide  upon  the  weights 
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Chat  he  assigned  to  the  cost  experiences  of  systesui  A,  B,  C,  D,  and  E  and 
why  did  he  select  the  cost  experiences  of  systems  A,  B,  C,  D,  and  E  to  use 
as  analogs  or  data  inputs  to  systea  X  as  opposed  to  the  cost  experiences 
of  same  other  systeu? 

Because  of  the  critical  importance  of  this  issue  in  costing  a  military 
system,  it  would  be  desirable  to  have  completely  explicit,  non-personal 
criteria  for  answering  these  questions.  Such  objectivity  can  never  be 
completely  attained  because  the  criteria  must  be  applied  by  an  analyst  to 
fit  each  particular  costing  project,  and  this  application  cannot  be 
completely  divorced  from  the  judgment  and  temperament  of  the  analyst.  How¬ 
ever,  as  his  ideal  the  methodologist  should  strive  to  devise  criteria  that 
will  became  increasingly  insensitive  to  the  implicit  personal  whims  and 
temperament  of  the  analyst,  and  that,  in  effect,  will  insure  that  one  type 
of  data  will  be  weighted  or  rated  sure  heavily  than  another  under  specified 
conditions  whatever  the  temperament  or  personality  characteristics  of  the 
analyst. 

Illustrative  of  the  types  of  criteria  envisioned  are  the  following. 

7.4.2  Validity  and  Eelevance 

Bach  data  input  should  be  evaluated  from  two  points  of  view,  namely, 
its  validity  and  its  relevance.  Kelative  to  validity,  how  accurately  does 
a  piece  of  data  measure  the  element  or  activity  it  purports  to  measure? 
Concerning  relevance,  how  directly  pertinent  to  a  new  system  element  is 
the  cost  experience  of  a  prior  or  current  system?  Generally,  the  weight 
attached  to  a  data  input  should  vary  directly,  both  with  the  validity 
and  relevance  of  the  data.  A  problem  frequently  is  that  data  which  have 
had  their  validity  firmly  established  by  substantial  empirical  studies  are 
of  limited  relevance  to  a  future  requirement  whereas  a  data  input,  such  asa 


guest  imate  of  a  specialist  in  a  particular  technological  field  a ay  be 
highly  relevant,  but  lacking  in  any  substantial  confirmation  of  its 
validity. 

7.4.3  State-of-the-Art 

Pursuing  the  previous  point,  generally  historical  data  should  be 
weighted  sore  heavily  than  opinion  if  the  goal  is  to  estimate  the  cost  of 
an  element  whose  technology  lies  within  the  current  state-of-the-art.  A 
subtle  qualif ication  is  that  opinion  merits  an  important  weight  even  when 
the  probleir  is  within  the  state-of-the-art  if  the  source  of  the  opinion 
is  an  acknowledged  expert  and  he  can  show  concrete  evidence  why  the 
historical  statistics  do  not  accurately  measure  the  element  they  were 
supposed  to  measure  or  he  can  present  a  convincing  case  why  general  price 
level  changes,  learning  curve  phenonema,  or  other  considerations  will  alter 
historical  experience  insofar  as  future  coa*:s  are  concerned. 

If  the  goal  is  to  estimate  the  cost  of  an  element  whose  technology 
lies  beyond  the  cuirent  state-of-the-art ,  projected  costs  —  as  defined  in 
Chapter  6  --  gain  in  relative  stature  and  weight  as  compared  to  historical 
-tatistics.  The  further  beyond  the  current  state-of-the-art  lies  the 
technology  of  a  new  requirement,  the  greater  is  the  importance  that 
attaches  to  expert  opinions  and  projections  as  a  data  source.  For  instance, 
consider  the  problems  involved  in  estimating  the  computer  maintenance  costs 
of  a  three  generation  early  warning  system  of  increasing  technological 
sophistication.  The  historical  data  on  the  costs  of  the  basic  System  Aq 
will  be  heavily  weighted  in  estimating  the  costa  of  System  A^.  However,  in 
estimating  the  costs  of  System  A 2  ,  the  weight  attached  to  the  historical 
data  on  the  basic  System  ^will  decline  in  relative  importance,  and  sub¬ 
stantial  weight  will  be  attaches  to  the  projected  costs  of  Sys*<se  A^ , 
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as tuning  that  nr  historical  data  are  available  sc  when  A2  oust  he  cost 
estimated. 

7.4.4  Supporting  Evidence 

Supporting  evidence  or  outward  symptoms  of  "quality",  as  demonstrated 
by  such  things  as  documentation  detail,  should  be  used  as  a  criterion  to 
weight  both  historical  costs  and  expert  opinions.  For  instance,  one 
objective  (non -personal)  measure  of  "quality"  is  the  currency  of  the  input. 
Thus,  by  and  large,  a  later  historical  report  on  a  given  area  of  cost  will 
normal!/  take  precedence  over  an  earlier  report.  Or,  if  the  same  expert 
or  two  experts  of  equal  competence  estimate  at  six-month  intervals  a  given 
cost,  the  latest  estimate  will  normally  be  rated  more  heavily. 

In  cons  dering  the  credence  or  weight  to  be  attached  to  historical 
data,  such  considerations  as  sample  size,  representativeness,  and  con¬ 
sistency  of  relationship  should  be  evaluated.  In  other  words,  historical 
data  aic  frequently  samples  rather  than  a  complete  tally. In  such  cases 
it  is  pertinent  to  inquire  as  to  how  many  observations  were  in  the  sample 
and  how  typical  or  representative  of  the  universe  or  population  was  the 
sample.  If  the  historical  experience  is  expressed  as  a  single  value,  it 
is  pertinent  to  inquire  as  to  how  consistent  a  relat ionship ,  how  much 
dispersion  within  the  observed  range,  do  the  raw  data  reveal. 

In  evaluating  projected  data,  it  is  most  important  to  avoid  u,.  ue 
glibness  relative  to  expert  opinion.  In  this  case,  as  with  historical 
data,  it  is  well  to  look  for  objective  evidence  of  careful  research, 
qualitative  and  quantitative,  to  support  the  opinion.  Each  expert  should 
also  be  carefully  assessed  on  such  bases  as  his  reputation,  the  effort 
applied  in  reaching  the  particular  opinion,  and  what  might  be  called  his 

"consensus  rating*!.  Thus,  by  virtue  of  their  past  successes  and  failures 
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is  estimating  future  trends  end  costs,  some  experts  have  developed  greater 
reputations  than  others,  and  thus  should  be  weighted  too re  heavily.  How¬ 
ever  ,  reputation  is  not  a  sole  and  sufficient  criterion,  and  it  is  desirable 
to  dif f erentiate  among  even  acknowledged  experts  for  the  relative  tine  and 
effort  they  spent  in  making  a  particular  estimate.  Even  the  most  experienced 
authorities  have  been  known  to  make  purely  intuitive  guesses  when  pressed 
to  do  so  or  when  time  is  short  Failing  all  else,  there  is  some  safety  in 
numbers.  A  consensus  of  expert  opinions  is  normally  better  than  one,  and 
especially  when  projecting  advanced  developments,  one  way  of  evaluating 

an  individual  expert's  opirior.  is  the  extent  to  which  it  is  shared  by  his 
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col  1 eagues . 

The  above  criteria  are  merely  indicative  of  the  type  of  weighting 
criteria  that  might  be  developed  to  Convert  cost  data  inputs  into  cost 
data  outputs  (system  element  costs).  Ao  indicated  previously,  extremely 
little  formal  methodological  research  has  been  done  on  this  very  important 
step  in  estimating  the  costs  of  a  military  system.  Like  in  the  other 
military  applications  of  weighting  methodology  alluded  to  in  Section  7.2.2, 
further  research  in  the  realm  of  cost -data  -  input  weighting  criteria  should 
be  directed  toward  finding  increasingly  more  explicit  and  reproducible, 
preferably  quant  measures  of  what  are  essentially  ^l^utlve 

phenomena . 

7  5  The  Problem  of  Uncertainty 

751  Nature  of  Problem 

One  of  the  most  baffling  problems  that  frequently  confronts  a  cost 
analyst  is  how  to  make  his  cosc  estimates  reflect  the  tremendous 
uncertainties  that  often  underlie  his  findings. ^ 


Although  the  relative  importance  of  minimixing  uncertainty  in  the 
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cost  estimate  varies  t/Rh  *ur  client's  intended  application  of  the 
estLnate  (Chapter  2),  it  is  aivsys  desirable,  whatever  the  type  of  estimate, 
to  reduce  uncertainty.  The  importance  of  uncertainty  lies  In  the 
implication  it  has  fct  the  ciienc  if  the  ..  «£.. 'jsites  he  receives  are 

seriously  in  error.  Since  comparative  costs  are  property  regarded  as  one 
of  the  appropriate  criteria  in  choosing  among  system  alternatives,  a 
seriously  erroneous  cot  estimate  can  lead  to  seriously  wrong  choices 
among  system  alternatives  with  the  result  of  gross  misal locations  of 
resources  among  different  programs. 

7-5.2  Historical  Record 

In  approaching  the  subject  of  uncertainty  as  it  applies  to  system 
cost  estimating  it  is  useful  to  examine  the  historical  record  concerning 
the  relative  accuracy  of  system  cost  estimates  in  the  past.  In  some 
cases  data  are  too  sparse  to  make  a  comprehensive  examination;  for  instance, 
large  military  electronics  syr.*ems  and  space  systems  are  too  recent  a 
development  to  make  definitive  post-mortems  of  advanced  systems  cost 
estimates  completed  to  date.  As  far  as  the  writer  knows,  no  one  has,  to 
date,  examined  systematically  the  limited  data  that  are  available  in  these 
fields. 

As  mentioned  in  Chapter  2,  RAND  has  made  a  series  of  empirical 

studies  covering  airctaft  and  missile  systems.  The  major  findings  of 

* 

these  studies  have  been  as  follows: 

a.  Many  advanced  system  cost  estimates  have  seriously  erred. 

b.  Most  of  theee  errors  have  been  underestimates  rather  than  over¬ 
estimates. 

c.  There  has  been  quite  a  range  in  error  from  system  to  system.  One 
of  the  consequences  of  thl*  wide  range  is  that  It  is  not  practical 
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to  are old  seri error*  i-  fut  ire  cast  estimates  merely  by  adding 
a  »t*nderd  "fudge  factor'  t.»  ell  first -par  cost  estimates. 

To  the  extent  that  the  reasons  for  past  errors  can  be  traced  or 
inferred,  "reqiirenents  uncertainty*'  far  out  ranks  in  importance 
"cost  estimatlig  uncertsinty".  In  other  words,  most  costing 

i 

l 

errors  have  been  due  to  the  fact  that  the  system  configuration 

changed  substant tally  ta  the  system  progressed  from  initial 

i 

I 

concept  through  operating  capability,  not  the  fact  that  the  cost 

I 

analyst  wrongly  priced  the  resources  cf  the  initir.l  configuration. 

As  an  illustration,  if  a  serious  error  in  the  total  system  cost 

I 

could  be  traced  to  a  najer  error  in  personnel  costs  it  would 
normally  be  attributable  to  the  fact  that  the  cost  analyst  was 
proceeding  from  seriously  mistaken  information  relative  to  the 
types  and  numbers  of  personnel  required  rather  than  the  fact 
that  h*  incorrectly  costed  an  airman  at  §3,000  per  year  rather 
than  at  §4  500. 

g 

Additional  RAND  studies  have  shown  that  cost  uncertainties  and 
probable  errors  in  system  costs  are  highly  correlated  with: 

(1)  the  stage  of  the  system's  development  during  which  the  cost 
estimate  is  made  The  earlier  in  the  system's  development 
cycle  that  the  estimate  is  made,  the  greater  are  the  chances 
of  a  serious  costing  error. 

I 

(2)  the  length  of  the  system's  development  period.  Systems  with 
long  development  periods  are  more  susceptible  to  serious 
costing  errors  than  are  systems  with  short  development  periods. 

(3)  the  degree  of  technological  advance  required.  The  greater 

is  the  amount  of  technological  advance  required  to  satisfy 
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the  ijita'i  requirement a,  the  greater  are  the  chances  of 
a  serious  costing  error. 

However,  as  a  practical  matter  it  is  generally  hard  to  measure  any 
of  these  parameters  at  all  precisely  and,  therefore,  it  is  hard  to  use 
these  findings  to  guescimate  how  much  uncertainty  exists  and  how  much 
relative  inaccuracy  is  likely  to  characterize  any  given  cost  estimate. 

7.5.3  Four  Objectives 

The  cost  analyst  an*.1-  his  client  are  interested  in  doing  four  things 
about  uncertainty: 

a.  A  basic  objective  eliding  practically  everything  the  cost  analyst 
does  on  a  costing  proiect  is  to  reduce  the  uncertainty  surrounding 
his  findings.  He  strives  to  end  up  at  the  conclusion  of  his  study 
with  a  residual,  hard-core  uncertainty. 

b.  After  he  has  done  everything  possible  to  minimize  uncertainty, 
the  analyst  wants  to  be  in  a  position  where  he  can  assess  both 
the  nature  and  magnitude  of  the  remaining  uncertainty  with 
reasonable  confidence.  Actually,  of  course,  he  attacks  this 
"nature  and  magnitude"  problem  from  the  beginning  of  the  study 
(Chapter  2),  because  he  cannot  proceed  systematically  to  reduce 
uncertainty  until  he  knows  wherein  it  lies  The  "nature''  of 
uncertainty  refers  here  to  such  considerations  as  whether  the 
major  uncertainty  is  "configuration  uncertainty",  as  defined 
above,  or  "cost  estimating  uncertainty";  also,  it  is  concerned 
with  identifying  which  particular  cost  elements  are  characterized 
by  the  greatest  uncertainty. 

c.  After  he  has  clarified  in  hio  own  mind  the  nature  and  magnitude 

of  the  residual  uncertainty,  the  analyst  wants  to  convey  to  his 
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client  as  r»aningfully  as  he  can  his  (the  analyst's)  knowledge 
and  feelings  relative  to  this  uncertainty. 


d.  Finally,  it  is  a  joint  responsibility  of  the  cost  analyst,  the 
cost  methodologist  and  the  client  to  determine  as  specifically 
as  possible  how  this  information  concerning  uncertainty  can  be 
used  to  make  better  cost/ef fectiveness  type  decisions  in  system 
selections  than  single-value  estimates  can  provide. 

1 . 5.4  Reducing  Uncertainty 

Since  there  is  a  close,  inextricable  connection  between  uncertainty 
and  the  accuracy  of  cost  estimates  all  system  cost  methodology,  including 
the  total  content  of  this  document,  is  addressed  by  implication  toward 
helping  the  cost  analyst  reduce  uncertainty.  For  instance,  the  emphasis 
placed  in  Cnapter  3  on  the  analyst  making  the  description  of  the  system 
to  be  costed  an  early  and  continuing  responsibility  reflects  the  fact  that 
historically  most  wrong  cost  estimates  can  be  traced  to  the  difficulties 
(uncertainties)  associated  with  correctly  describing  the  system  to  be 
costed.  Ill 


7.5.5  Assessing  Uncertainty 

As  Indicated  in  7  5  3  above,  the  task  of  pinpointing  the  nature  ard 

I 

magnitude  of  uncertainty  is  a  continuing  task  that  the  analyst  faces  from 

the  beginning  to  the  end  of  a  study.  If  he  has  systematically  attacked 

his  first  task,  namely,  reducing  uncertainty,  he  will  have  progressed 

timrard  assessing  uncertainty  even  if  he  has  not  been  successful  in  actually 

reducing  this  uncertain: In  other  words,  he  should  have  a  fair  under* 

standing  as  to  what,  specifically,  he  is  uncertain  about. 

At  this  point,  however,  a  word  of  caution  Is  retired.  In  practice, 

these  element -bv-element  uncertainty  assessments  are  likely  to  be  highly 
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personalized  in  terms  of  the  temperament  or  even  the  temporary  mood  of  the 
analyst.  Thus,  two  different  analysts  when  confronted  with  the  same  set 
of  data  inputs  are  liable  to  arrive  at  vastly  different  uncertainty 
assessments,  and  even  the  same  analyst,  depending  upon  his  temporary 
stood ,  may  arrive  at  much  different  uncertainty  assessments.  The  almost 
inherent  capriciousness  of  this  undertaking  is  a  major  obstacle  toward 
systematizing  the  process  of  cost  estimating.  To  the  extent  that  this 
capriciousness  is  not  dealt  with,  the  uncertainty  assessments  may  do  as 
much  harm  as  good, especially  if  the  analyst  and  client  both  place  any 
substantial  confidence  in  these  assessments. 

There  is  really  only  one  way,  known  to  the  writer,  of  reducing 
capriciousness  and  intuition  in  this  area.  This  is  to  aim  for  greater 
explicitness  and  replicability  in  deriving  and  documenting  the  rationale 
supporting  uncertainty  assessments.  The  basic  characteristics  and 
illustrative  examples  of  this  explicitness  for  single  value  estimates 
were  outlined  earlier  in  this  chapter.  Elements  of  this  explicitness 
were  contained  [in  the  RAND  "Delphi"  experiments  cited  on  page  117  of  this  i 

chapter.  Operationally  wh*t  it  that  the  co*t  analyst  should 

1 1  * 

strive  to  support  both  logically  and  empirically  the  judgments  that  he 

reaches  relative  to  his  uncertainty  assessments.  The  value  of  this 
exercise,  as  explained  previously,  is  that  it  facilitates  a  check  for 
reasonableness  and  consistency  both  insnediately  by  the  cost  analyst, 
himself,  and  by  his  colleagues  on  the  project,  and  also  improves  the  chances 
of  long-term  learning  from  subsequent  feedback  information. 

But  there  is  still  another  problem.  Usually,  the  analyst's  knowledge 

or  feelings  relative  to  uncertainty  will  be  particularized  by  elements  1 

since,  as  noted  previously,  most  systems  are  costed  in  terms  of  their 
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constituent  elements.  A  remaining  task  is  to  translate  and  consolidate 
these  separate  element  uncertainties  into  an  integrated  expression  of  the 
uncertainty  in  the  total  system  cost  estimate.  Even  if  the  analyst  has 
succeeded  in  quantifying  his  uncertainties  on  an  element  by  element  basis 
into  a  range  of  costs  for  each  element,  it  is  not  legitimate  to  derive  an 
assessment  of  uncertainty  in  the  total  system  cost  estimate  merely  by  a 
straight  addition  of  the  ranges  for  the  individual  elements. 

Potentially,  this  consolidation  of  individual  element  uncertainties 

into  an  integrated  uncertainty  assessment  for  the  total  cost  estimate 

provides  another  field-day  opportunity  for  subjective,  intuitive  estimating. 

Fortunate! v ,  however,  it  is  not  necessary  to  resort  to  intuition  to  make 

this  integration,  provided  it  is  possible  to  quantify  the  individual 

element  uncertainties  it  to  a  probability  distribution,  if  it  is  possible 

to  so  quantify  the  individual  element  uncertainties,  techniques  have  been 

developed  which  make  it  possible  to  calculate  in  a  completely  explicit, 

reproducible  (non-personnal)  fashion  a  quantitative  estimate  of  the 

9 

uncertainty  in  the  total  system  cost  estiL^te. 

.  .  b . 6  Expressing  Uncertainty 

Restating  the  third  task,  after  the  analyst  has  clarified  in  his  own 
mind,  the  nature  and  magnitude  of  the  residual  uncertainty,  he  wants  to 
find  a  means  of  conveying  this  knowledge  to  his  client  as  meaningfully  aa 
he  can. 


There  are  various  means  the  analyst  can  employ  to  convey  his  knowledge 

relative  to  uncertainty.  Most  of  them  involve  probabilistic  statements 

and  they  are  mainly  differentiated  by  their  degree  of  specificity.  This 

differentiation  may  be  illustrated  by  the  following  hypothetical  example, 

beginning  with  the  single  value  estimate  with  no  uncertainty  assessment. 
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EXPANSION  FOHM 

1.  System  A  is  estimated  to  cost  $15M. 

2.  System  A  is  estimated  to  cost  $15M; 
however ,  the  analyst  is  not  sure 
(uncertain)  about  the  figure. 

3.  System  A  is  estimated  to  cost 
between  $11M  and  $19M. 


4.  There  is  a  "strong  probability" 
that  System  A' a  cost  will  be: 
$11M  -  $15M  -  $19M.  The  $15M  is 
some  measure  of  central  tendency 
(mean,  mode  or  mean).  The  $11M 
and  $19M  are  the  estimated  lower 
and  upper  *;ost  limits. 

5.  With  a  .95  probability.  System 
A's  cost  is  estimated:  $11M  - 
$131  -  $19M.  The  numerical 
expressions  have  the  same  meaning 
as  in  4  above. 


DEGREE  OF  SPECIFICITY 

1.  No  uncertainty  expression. 

2.  A  vague  qualitative  expression 
of  uncertainty  is  given. 

3.  A  range  is  given  to  express  the 
magnitude  of  uncertainty.  How¬ 
ever,  no  probability  information 
is  given;  it  is  not  stated 
whether  the  analyst  believes 
there  is  a  IX,  a  10X  or  a  100X 
chance  that  the  cost  will  fall 
between  $11M  and  $19M,  nor  is 

it  indicated  whether  the  cost 
is  likely  to  be  closer  to  $11M 
or  $19M. 

4.  An  adjective  descriptor  is  added 
to  convey  a  rough  indication  of 
probability. 


5.  The  adjective  descriptor  is 

replaced  by  the  sore  definitive 
numeral . 


6.  A  complete  probability  distribu¬ 
tion  is  given,  and  this  is 
deplete!  by  a  curve.  (Both  the 
problems  in  getting  the  Case  6 
type  information  and  the  anoint 
of  additional  information  pro¬ 
vided  by  Case  6  are  of  a  greater 
magnitude  vs  Case  5  than  Case  5 
is  vs  Case  4,  Case  4  is  vs 
Case  3,  etc.) 
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The  ab?ve  examples  at  provided  merely  to  illustrate  some  of  the 
types  of  uncertainty  exoressions  that  might  be  employed.  Many  variants 
o *  the  above  types  plus  other  basic  types  nrght  also  be  used.  For  instance, 
a  minor  variant  of  Example  3  above  would  Include  a  measure  of  cencral 
tendency  as  well  as  the  two  outer  limits.  Another  method  would  be  to 
express  the  range  in  standard  deviation  urf»-5  measured  from  some  measure 
of  central  tendency  Other  measures  --  short  of  a  complete  frequency 
distribution  --  aould  depict  the  relativeness  skewness  or  "peakedness** 
(xurtosis)  of  the  distribution;  also  a  "tail  probability**  could  be  used 
to  indicate  the  upper  or  lower  limits  of  the  distribution.  The  preferred 
measure  in  any  given  study  voolu  depend  upon  the  type  of  information 
available  to  the  analyst  the  client's  intended  use  of  the  estimate,  and 
the  client's  relative  familiarity  with  statistical  methods. 

7.5.7  Using  Uncertainty  Assessments 

In  the  past,  system  cost  methodologists  have  seldom  specified  how 
probabilistic  cost  estimates  or  other  uncertainty  assessments  could  be 
used  to  make  better  system  choice  decisions  than  could  single  value 
estimates.  (Raiffs  and  Sthlaiffer  have,  however,  treated  similar  problems 
in  a  more  general  context3*^By  the  same  tokm,  decision  makers  frequently" 
have  an  inherent  bias  against  probabilistic  answers.  The  decision  taalter, 
himself,  normally  has  to  make  single^value  type  system  proposals  to  his 
superiors,  e.g.,  requests  to  Congress  for  funding  must  be  for  a  specified 
number  of  dollars.  Moreover,  even  in  planning  type  problems,  probabilistic 
cost  estimates  usually  complicate  the  decision,  they  never  simplify  it. 

For  instance,  in  the  following  example  it  is  assumed  that  alternative 
systems  A  and  B  offer  equivalent  effectiveness  for  meeting  a  specified 
requirement. 
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Single 

Probabilistic 

System 

Value 

Estimate 

Estimate 

(95X  range) 

A 

$15K 

$12  -  15  -  18 

B 

$13M 

$10  -  13  -  20 

Whereat  the  tingle  value  estimate  clearly  tuggesta  System  B,  the 
probabilistic  estimate  offers  no  clear  mandate. 

Notwithstanding  its  tendency  to  complicate  the  decision  problem, 
probabilistic  estimates  offer  both  tangible  and  intangible  advantages 
over  single  value  estimates.  In  the  first  place,  the  additional  infor¬ 
mation  provided  by  a  probability  estimate  may  cause  a  decision  maker  to 
make  a  different,  and  what  he  regards  as  a  sounder  and  safer,  decision 
than  a  single  value  estimate  would.  This  is  likely  to  be  true,  for 
instance,  when  a  decision  maker  has  a  upper  limit  cost  threshold.  In  the 
following  illustration  it  is  postulated  Systems  A  and  B  offer  equal 
effectiveness  and  that  under  no  circumstances  does  the  decision  maker  want 
to  spend  more  than  $18M  on  the  proposed  system. 


wESZMKm 

Probabilities  1 

System  A 

System  B 

under  12.1 

0.3 

0.3 

12.1  -  15.0 

0.4 

0.3 

15.1  -  18.0 

0.3 

0.3 

18.1  -t  over 

0 

0.1 

Single  Value 

Cost 

$15M 

$14M 

In  view  of  the  upper  limit  cost  threshold  constraint,  Systai  A  may  be 

a  preferred  choice  over  B.  This  insight  would  be  forthcoming  from  the 

probabilistic  cost  estimate;  it  would  not  be  revealed  by  the  single  value 
estimate. 
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Second ,  even  whvn  a  decision  must  furnish  to  bis  superiors  a 

single  value  cost  tstiraie.  a  probab i 1 ist ic  cost  estimate  e&n  be  a  very 
useful  input  to  Mm,  especially  if  the  distribution  y%  upwardly  skewed, 
in  suggesting  that  provision  be  nade  for  either  an  explicit  or  implicit 
allowance  for  contingencies.  While  the  probabilistic  estimates  can  be  a 
useful  input  to  the  decision  maker  in  establishing  his  contingency 
allowance,  there  is  no  way  to  establish  the  amount  of  this  allowance  apart 
fron  the  client's  loss  structure  (Loss  structure  is  defined  here  as  the 
utility  or  disutility  a  client  assigns  to  various  types,  magnitudes,  and 
timings  of  possible  cost  outcomes  or  expenditures  )  Tf  the  client  puts  a 
‘•’e.ry  high  premium  or  not  running  short  of  funds,  if  he  does  not  want  to 
risk  a  program's  chances  of  a  sound  development  for  want  of  funda,  he 
will  set  a  high  contingency  allowance.  On  the  other  hand,  he  may  alao 
feel  that  if  he  establishes  the  contingency  allowance  at  a  very  high  figure, 
the  total  system  cost  may  be  so  high  that  DOD  may  disapprove  the  program. 
Only  he  can  balance  the  two  and  resolve  the  issue. 

Third,  probabilistic  cost  estimates  generated  as  an  input  to  a  planning 
type  decision  may  on  occasion  suggest  to  the  decision  maker  that  he  really 
does  not  have  sufficient  information  to  make  a  choice  among  his  existing 
alternatives  In  other  words,  the  probabilistic  estimates  may  suggest  that 
the  uncertainties  are  so  great  and  the  choice  among  the  alternatives  so 
inconclusive  that  the  best  decision  would  be  to  buy  more  information,  to 
do  additional  research  to  clear  up  some  of  the  uncertainties  relative  to 
existing  alternatives  or  to  uncover  or  create  new  alternatives  that  would 
be  superior  on  a  cost/effectiveness  basis  to  any  existing  alternatives. 
Again,  the  simpler  answers  provided  by  the  single  value  estimates  would 
mislead  the  decision  maker  FM  following  example  illustrates  this  point. 
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To  highlight  the  issue  it  **sa  been  assumed  that  effectiveness  as  well  as 
cost  is  subject  to  uncertainty,  a  not  at  all  unrealistic  premise. 


System 

Single  Value 

Estimates 

Probabilistic 

Estimates 

(95Z  range) 

effectiveness 

1 

Effectiveness 

Cost 

A 

100 

70  -  100  -  11C 

$ 13M  -  ISM  -  2 CM 

9 

90 

EBB 

75  -  90  -  120 

$13H  •  17H  -  21M 

(Kaiffa  and  Schlaiffer  have  devised  a  method  for  guiding  the  decision 
SMker  under  certain  circumstances  to  decide  how  much  money  it  is  worth 
spending  to  buy  additional  information,,  provided  the  client  can  spell  out 
in  sufficient  detcil  his  loss  structure  (how  much  specific  types  of 
information  would  be  worth  to  him,  etc.)  and  his  cost  distribution.) 

Fourth,  probabilistic  cost  estimates  are  valuable  in  that  they  prod 

decision  makers  to  think  sure  thoroughly  about  the  full  implications  of 

the  decisions  they  have  to  make.  For  instance,  the  range  of  possibilities 

posed  by  the  probabilistic  tyoe  data  exhibited  in  the  table  above 

is  much  more  likely  to  lead  a  decision  maker  to  examine  and  formulate  the 

details  of  his  loss  structure  than  is  a  single  value  estimate.  Finally, 

* 

having  been  alerted  to  the  specific  uncertainties  underlying  the  data  on 
which  he  must  make  his  decision,  the  military  planner  is  much  more  likely 
to  make  flexible  type  decisions,  is  much  less  likely  to  be  "caught  flat- 
footed"  if  subsequent  experience  disproves  the  most  likely  estimate,  and 
to  be  ready  with  alternative,  contingent  plans  that  will  minimise  his 
realignment  losses. 

Another  means  available  to  the  analyst  of  attacking  the  uncertainty 
problem  and  of  c o —in testing  the  resource  implications  of  this  uncertainty 
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to  his  client  is  through  cost  sensitivity  studies.  Through  these  studies 
s  cost  snslyst  can  is form  his  client  what  is  likely  to  be  the  impact  on 
total  system  costs  (the  range  of  costs)  from  varying  key  systems  performance 
or  design  psrameters  through  a  specified  set  of  alternatives.  This  type 
of  Information  will,  for  instance,  tell  a  client  how  much,  at  worst,  ha  may 
be  hurt  by  the  residual  uncertainty  in  his  system,  and  it  can  help  him 
decide  whether  to  buy  more  information,  to  retain  the  status  quo,  etc. 

1 . 6  Computerized  Cost  Models 
7.6  1  Definitions 

A  number  of  computerized  cost  models  have  been  developed  to  facilitate 
.he  process  of  estimating  a  system's  costs.  No  attempt  will  be  made  in  this 
document  to  review  in  any  detail  the  characteristics  of  these  models  since 
a  mere  description  of  any  one  of  them  would  take  many  pages.  However,  it 
la  pertinent  to  highlight  some  of  the  major  advantages  and  limitations  of 
such  models,  and  to  discuss  the  conditions  under  which  they  are  likely  to 
be  most  useful . 

Practically  all  system  cost  estimating  models  consist  of  a  series  of 
statistical  equations  or  cosi.  estimating  relationships  which  relate  various 
types  of  costs  to  each  other  and  various  types  of  costs  to  selected  per¬ 
formance  or  design  parameters  When  the  estimating  process  is  computerized, 
the  computer  audel  is  used  to  convert  these  various  input  relationships  into 
an  output,  a  system  cost  estimate 

In  this  paper  th »  discussion  will  focus  on  a  computer  cost  model 
developed  by  MITRE  to  cost  electronic  systems.  However,  many  of  the 
advantages  and  limitations  of  this  model  also  are  characteristic  of  other 
types  of  cost  models.  A  deta  led  description  of  the  MITRE  cost  model  is 

contained  in  the  paper  by  T.  Jannsen,  H.  Glazer,  and  J.  DesRoches  referenced 
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In  Chapter  4  (page  71,  footnote  2).  This  Model,  when  furnished  with  the 
necessary  input  date,  including  a  description  of  the  system  in  terms  of 
its  elements,  the  statistical  (cost)  relationships  between  these  elements, 
and  a  description  of  the  output  tables  desired,  will  automatically  calculate 
and  print  the  desired  cost  estimates.  Many  of  the  required  inputs  are 
routinely  stored  within  the  model  end  the  analyst  selects  the  appropriate 
ones  or  Inserts  new  ones  into  the  model  when  he  wishes  to  make  an  estimate. 

7.6.2  jbffillc  ltness 

Because  a  computer  can  only  accept  expressly  defined  and  quantitlvely 
stated  Inputs,  the  decision  to  use  a  cost  saodel  automatically  imposes  on 
the  analyst  a  requirement  to  be  more  explicit  and  systematic  in  working 
out  and  documenting  his  cost  estimating  methodology  than  might  be  the  case 
if  the  mechanics  of  his  estimating  procedure  were  purely  manual.  In  this 
sense  a  cost  model  contributes  to  a  realisation  of  the  advantages  of 
systematic  analysis  expounded  in  this  paper. 

However,  this  point  should  not  be  pushed  too  far.  Although  the  use 
of  a  model  requires  an  explicit  statement  of  the  various  inputs  used,  a 
computerised  procedure,  no  more  than  a  manual  procedure,  can  Insure  that 
these  inputs  are  derived  in  an  explicit,  replicable  fashion.  Historically, 
much  of  the  snst  damaging  implicitness  of  manual  costing  procedures  arise 
in  connection  with  the  derivation  of  the  estimating  relationships,  and  no 
computer  model,  per  sc,  can  correct  this  condition. 

7.6.3  Time  Savina 

It  is  in  the  realm  of  saving  time  in  calculating  end  printing  the  cost 

findings  that  potentially  a  computerised  cost  model  offers  its  greatest 

potential  advantage.  To  the  extent  that  it  does  so,  a  computerised  model 

can  make  it  possible  for  the  estimating  staff  to  spend  relatively  more  time 
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In  analyzing  the  coat  results  as  opposed  to  routine  processes  of  calculating 
and  printing  such  results.  This  advantage  Is  likely  to  be  most  evident, 
of  course,  uhen  the  arithmetic  calculation  work  is  vary  large.  Most  notably 
this  is  the  case  in  cost  sensitivity  studies  for  orienting  the  system 
design  in  advanced  planning  projects.  In  such  cases  a  computerized  mode., 
makes  it  possible  to  proceed  quickly  through  many  cost  iterations  to 
ascertain  the  impact  on  total  system  cost  of  varying  the  oi  selected 

system  performance  or  design  parameters  Similar  advantages  accrue  in 
force  structure  analysis  when  it  becomes  necessary  to  make  an  element -by- 
element  estimate  concurrently  of  several  hundred  different  systems. 

Two  cautions  should  be  noted,  however,  in  this  connection.  First,  a 
certain  amount  of  set-up  time  is  usually  required  to  computerize  the 
est  it.'-at  ing  procedure  of  a  particular  problem.  Unless  the  total  calculation 
workload  is  substantial,  the  total  time  required  to  process  an  estimate 
through  a  computerized  model  may  be  as  great  or  greater  than  for  a  manual 
costing  operation  in  which  a  desk  calculator  is  used  for  the  arithmetic 
operations.  In  practice,  very  many  aystem  cost  projects  require  a  relatively 
small  calculating  workload  in  which  the  estimating  relationships  used  are 
very  simple  linear  factors.  In  such  cases  a  computerized  cost  model  will 
not  save  time  in  calculating  a  system's  cost. 

Second,  when  a  computerized  procedure  does  save  time,  it  is  mostly  in 
the  realm  of  relatively  routine  tasks  --  arithmetic  calculation,  printing, 
and  reproduction.  Most  of  the  existing  computerized  cost  models  usually 
do  not  save  time  in  areas  where  an  analyst  spends  most  of  his  time  -- 
defining  the  requirement  and  configuration  to  be  costed,  collecting  and 
evaluating  his  cost  inputs,  and  writing  and  interpreting  his  narrative 


report . 
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7.1.4  fitafrBtftiop 

Chapter  9  vill  discuss  in  som  detail  the  importance  of  proper 
presentation  of  the  cost  findings  to  the  client  and  the  problems  in  doing 
so.  It  is  relevant  here,  however,  to  coesaent  briefly  on  the  suitability 
of  the  computer  printout  as  a  presentation  format.  In  some  quarters  the 
high  respect  accorded  generally  to  the  computer  as  a  powerful  research  tool 
My  generate  in  the  mind  of  the  client  a  high-order  confidence,  sometimes 
unwarranted,  for  the  cost  findings,  themselves.  On  the  other  hand,  some 
clients  find  it  more  difficult  to  follow  the  computer  printouts  than 
a  simple,  typewritten  page.  When  this  is  the  case,  the  computer  presentation 
My  hinder  the  analyst  in  effectively  communicating  his  findings  to  his 
Client. 

In  staomary,  a  computerised  cost  sudel ,  like  other  cost  analysis  tools 
(standardised  cost  structures,  generalised  cost  estimating  relationships, 
and  techniques  to  assess  and  express  uncertainty),  can  be  a  powerful 
research  tool  if  used  with  discrimination.  It  is  not,  however,  a  general 
purpose  tool  suitable  for  all  occasions. 

7.7  Summary 

This  chapter  has  been  concerned  with  the  mechanics  of  converting  cost 
data  inputs  into  cost  element  estimates.  It  has  been  noted  thst  the  com¬ 
plexity  of  this  operation  is  a  function  primarily  of  the  number,  diversity, 
validity,  and  relevance  of  the  data  Inputs  to  the  new  element  being  costed. 

Whenever  the  analyst  has  two  or  more  data  Inputs  relating  to  a  cost 

element,  he  must  weight  these  inputs  in  reaching  his  estimate  of  the  cost 

of  the  new  element.  If  this  weighting  is  to  be  done  objectively,  rather 

than  subjectlvtly,  two  methodological  steps  mutt  be  taken.  One,  relatively 

explicit,  measuraable  criteria  must  be  established  for  accomplishing  this 
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weighting.  Second,  e  format  must  be  established  for  combining  end  displaying 
or  document ing  the  weighting  determinations.  Illustrate  e  criteria  and 
formats  have  been  discussed  in  this  chapter. 


The  problem  of  handling  uncertainty  is  one  of  the  most  difficult 
confronting  the  cost  analyst.  There  tre  four  facets  of  this  problesi: 
how  to  reduce  uncertainty,  how  to  assess  ito  nature  and  magnitude,  how 
the  analyst  can  meaningfully  communicate  his  findings  relative  to  uncertainty 

I 

to  his  client,  and  how  the  client  can  use  these  uncertainty  assessments  to 
make  better  cost/effectiveness  decisions  than  can  s jiggle  value  estimates. 

A  computer  cost  acdel  will  save  substantial  time  and  offer  other 
related  advantages  when  the  erithawtic  workload  in  calculating  a  system's 
cost  is  substantial  such  as  in  coat  sensitivity  studies  and  force  structure 
analysis. 

* 
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Although  literally  doaena  --  perhaps  hundreds  --  of  article*  on  117 

uncertainty  have  oppeared  in  the  learned  journals,  very  few  of  then 
have  auch  practical  relevance  to  syataa  coat  analysis.  Once  again 
in  thie  instance  the  BAND  literature  is  the  aost  directly  relevant, 
e.g.,  flitch  and  McKean,  op .  clt.  pp.  188-205, and  G.  H.  Fisher,  "A 
Discussion  of  Uncertainty  in  Cost  Analysis  (A  Lecture  2or  the  AFSC 
Cost  Analysis  Course),"  BAS)  SX-3071PK,  April  1962.  Also  relevant 
in  a  general  sense  are  the  writings  of  Reward  Kaiffa  and  Iovert 
Schlalffer,  e.g.,  Applied  Statistical  Decision  Theory  (Harvard 
University,  1961). 

g.  ,  Robert  Sinners  .  "Cost  Estimates  as  Predictors  of  Actual  ’-19 

Weapon  Costs:  A  Study  of  Mator  Hardware  Articles,"  RAND  RM-3061PR, 

April  1962. 
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fh«  preceding  several  chapters  hive  been  concerned  estentlslly  with 
bow  beat  to  maaure  the  generally  recognized  direct  aisslon  cost  element* 
of  a  system.  Illustrative  of  such  evict  aleaents  would  be  the  purchase 
cost  of  an  electronic  confute;  to  sanm  as  a  aajor  nisi ion  eleaent  of  a 
tystsa,  the  coats  cssoclatad  with  hiring  a  private  contractor  to 
Initially  write  and  periodically  up-date  the  coaputer  program  essential 
to  the  use  of  this  computer,  and  the  construction  of  a  new  building  in 
uhich  to  house  this  coaputer.  Vo  one  questions  that  any  of  these  costa 
are  legit lasts  costa  of  the  hypothetical  ays tea.  Methodological  or 
procedural  questions  ere  concerned  principally  with  the  aoat  accurate 
aad  expeditious  swans  of  estimating  thase  costs  3  to  10  years  before 
Che  eye tea  becomes  operational. 

In  this  chapter  the  discussion  returns  to  a  question  alluded  to  in 
Chapter  2,  neatly,  how  should  cost  be  defined,  l.e.,  what  types  of  cost 
Should  he  included  or  excluded  froa  the  definition?  The  issue  probably 
can  be  epitomised  in  e  distinction  between  the  two  basic  concepts  of  coat 
discussed  in  Chapter  2  neatly,  the  distinction  between  a  cash-flow 
concept  appropriate  for  funding  type  decisions  end  e  value-flow  concept 
eppropriete  for  planning  (cholce-eaong-alternatives)  type  decisions.  The 
value- flow  concept  contends  that  in  order  to  obtain  a  complete  end  true 
•assure  of  the  total  resource  lapse t  of  e  systea  alternative,  it  le 
frequently  necessary  to  Include  as  laportant  costs  certain  eleaents  not 
reflected  in  the  flow  of  funds  required  to  develop,  acquire,  end  operate 


a  eye  tea. 


Conceptually,  «om  of  thaac  coat#  are  afcln  to  vbat  economists  have 
termed  "external  aconoailaa  and  diseconomies."  Hitch  and  McKean,  borrow¬ 
ing  a  tana  frow  J.  N.  Buchanan,  call  these  coats  "spillovers."*  Bom  of 
thaaa  coata  alao  derive  frow  the  economist's  notion  of  an  opportunity 
coat  in  the  aenaa  that  a  declalon  to  uae  a  acarce,valuable,  multi- purpose 
raaovree  in  ona  way  precludea  ita  uae  In  other  alternative,  productive 
employments.  Accountants  wight  label  a owe  of  theae  coata  aa  inputee 
coata  in  the  aanae  that  aowe  actlvltlca  of  System  A  Indirectly  have  re* 
source* or tented  lwpllcationa  or  reaction*  on  another  Syatew  B  without 
directly  end  necessarily  causing  a  change  in  the  funding  to  Syatew  B. 

The  wain  concern  of  the  present  chapter  will  be  to  discuss  the 
problems  involved  in  identifying  acme  of  these  value-flow  type  costa 
and  in  weaaurlng  thew  once  identified. 

S-2  Herd-To-Heeaure  Cotta 

B.2.1  Inherited  Assets 

A  new  syatew  frequently  "inherits"  aowe  of  the  resources  raquired 
for  its  development  and  operation  froa  other  systewe  previously  or 
currently  deeaphasleed  or  phased  out  of  the  military  force. 

A  coat  eetlwete  prepared  for  funding  purposes  will  not  include  e 
charge  for  inherited  eaaeta,  g^r  **,  because  the  eseeta  were  paid  for 
by  the  previous  user.  In  other  words,  no  new  funding  is  involved, 
except  perhaps  to  rapclr,  modify  or  transport  the  essat  to  the  new 
user. 

However,  if  the  objective  is  to  prepare  an  eetiwete  of  the  total 
reel  coat  iwpece  of  a  ays tew  end  to  use  this  coat  estimate  aa  one 


criterion  in  evaluating  the  subject  syatew  cowpetltively  against  other 

eystewa  as  a  weans  of  accomplishing  e  given  mission  or  of  enhancing  the 
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nation's  ailitarv  posture  most  cost  methodologists  would  agree  that 
under  certain  conditions  the  cost  estimate  should  include  some  charge 
for  inherited  assets. 

The  rationale  for  this  principle  is  an  outgrowth  of  the  neo¬ 
classical  economics  concept  of  "opportunity  costs"  and  has  been 
recommended  by  manv  authorities  as  applicable  in  civilian  costing 
as  well  as  military.^  tn  effect  the  principle  states  that  the  true 
cost  of  a  resource  used  in  one  employment  is  represented  by  the 
foregone  opportunities  of  using  that  resource  elsewhere.  Hitch  and 
He  Kean  in  discussing  its  application  to  military  systems  costing 
have  coined  the  term  "alternative  use"  principle.*  The  conceptual 
and  empirical  ramifications  of  this  doctrine  will  be  discussed  later. 

8.2.2  Shared  Assets 

A  new  system  may  not  require  the  full  and  exclusive  use  of  all  of 
the  resources  contributing  to  its  effectiveness.  In  other  words,  a 
system  will  normally  share  with  other  systems  the  services  of  certain 
mission-type  or  sup, ort  assets.  An  example  of  shared  mission-oriented 
assets  would  be  communication  lines  functioning  as  subsystems  of  two 
or  more  systems.  On  the  other  hand,  support  type  assets  or  services 
can  be  at  either  high  or  low  echelons  of  authority.  For  Air  Force 
systems  examples  of  nigh-level  support  services  are  those  provided 
by  Headquarters  I'SAF,  AFSC,  AFLC,  A K,  the  Air  University,  and  the 
Office  of  Aerospace  Research.  Examples  of  low  echelon  support  activities 
on  the  post.  camp,  or  station  level  are  the  mail  service,  dispensary, 
and  commissary. 

Once  again,  a  funding  esi.  ate  prepared  m  support  of  a  given  system 

frequently  will  not  include  a  charge  for  such  services  because  the  total 
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funding  requirements  for  such  activities  are  financed  on  a  consolidated 
basis  through  other  echelons. 


However,  resources  consumed  in  providing  such  joint  services  are  In 
principle  as  such  a  drain  on  the  Defense  budget  and  on  the  gross  national 
product  as  are  those  directed  to  meeting  the  exclusive  requirements  of  a 
system.  Again  for  the  purpose  of  estimating  the  total  cost  impact  of 
a  new  system  in  order  to  evaluate  it  on  a  cost/effectiveness  basis 
against  other  systems,  thera  ia  no  rational  reason  for  ignoring  such 
costc.  There  are,  however,  real  practical  problems  in  identifying  and 
measuring  these  coats  in  a  system  context  and  they  will  be  considered 
later. 

8.2.3  Fixed  Supply  Assets 

The  level  of  Defense  Department  expenditures  for  certain  very  im¬ 
portant  classes  of  resources  are  comparatively  insensitive  to  the 
requirements  of  a  particular  system  for  these  resources.  For  instance. 
Congress  decides  on  the  total  size  of  tne  military  force  and  on  the 
respective  strengths  of  each  Service  (Army  Wavy,  and  Air  Force) 
substantially  independently  of  the  anticipated  needs  of  particular 
"systems"  or  "program  elements"  for  military  personnel.  Thus,  in  recent 
years  for  diverse  and  complex  reasons  Congress  has  set  the  size  of  the 
total  Armed  Forces  at  approximately  2.500,000  military  personnel  and  the 
Air  Force  at  800.000  -  900,000  military  personnel.  The  particular 
strengths  authorized  were  substantially  uninfluenced  by  whether  electronic 
system  XYZ  anticipated  a  need  for  1,000  men  or  5,000  men. 

Similarly,  in  terms  of  budget  procedures,  military  personnel  ex¬ 
penditures  are  funded  on  a  consolidated  basis  and  the  funding  estimate 
prepared  on  the  lower  echelon  system  level  normally  does  not  include 
military  personnel  costs.  However,  higher  echelons  of  the  Air  Force  and 

the  Department  of  Defense  try  to  allow  for  such  costs  in  evaluating 
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alternative  system  proposals.  Headquarters  USAF,  for  instance,  adds 
military  personnel  costs  to  the  PS??  (Proposed  System  Package  Programs) 
before  submitting  the  programs  to  D00  for  approval. 

Again,  as  In  the  case  of  support  costs,  if  the  cost  estimate  is 
intended  as  an  input  tu  a  planning  type  decision,  it  is  appropriate  to 
take  account  of  the  comparative  military  personnel  requirements  of  the 
several  alternative  systems.  However,  there  are  practical  problems  in 
doing  so,  and  these,  too,  will  be  discussed  liter. 

8.2.4  Salvage  Values 

A  rationally  (economically)  motivated  private  consumer  does  not 
ignore  the  potential  eventual  trade-in  value  of  an  automobile  when 
he  estimates  what  will  be  the  real,  net  costs  to  him  of  owning  an 
automobile  or  in  making  a  choice  among  different  automobiles. 

Similarly,  in  estimating  the  real  costs  of  his  alternative  systems, 
a  rationally  (economically)  sotivated  military  decision  maker  should  not 
ignore  the  differences  in  potential  salvage  values  that  his  various 
system  alternatives  ma>  offer  when  they  are  eventually  discontinued. 

For  instance,  if  System  A  costs  $50,00^,000  and  has  anticipated 
salvage  values  to  successor  systems  of  $10,000,000,  its  net  cost  is 
$40,000,000.  On  the  other  hand,  if  System  B  costs  $60^000,000  and  has 
anticipated  salvage  values  to  successor  systems  of  $25,000,000,  its  net 
cost  is  $35,000,000.  In  effect,  the  real  resource  drain  of  System  B  is 
less  than  A  even  though  its  initial  gross  costs  are  greater. 

The  foregoing  type  considerations  are  not  germane  whjn  calculating 
the  short-term  funding  requirements  of  a  particular  system.  They  are, 
however,  pertinent  when  the  ob’  ctlve  is  to  make  optimum  use  of  die 
Department  of  Defense  total  resources  in  a  long-term  context.  The 
difficulties  of  implementing  this  guidance  will  be  discussed  later. 
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8.2.5  Spillovers 


A  leading  characteristic  of  large  military  systesm  is  the  close 
functional  inter-mesh  and  great  operational  interdependency  among  such 
systems.  In  costing  a  system  for  planning  purposes  -  when  the  objective 
is  to  estimate  the  total  real  net  costs  of  a  system  -  the  cost  analyst 
should  be  alert  to  the  possibility  that  the  introduction  of  a  new  system 
can  indirectly  give  rise  to  either  increases  or  decreases  in  the  costs 
of  other,  related  systems.  Once  again  from  the  point  of  view  of  ex¬ 
tract1.^  the  most  mileage  froa  the  defense  dollar  with  the  objective  of 
securing  the  strongest  possible  total  military  posture,  these  spillovers 
should  be  considered  in  evaluating  system  alternatives. 

Illustrative  of  the  spillover  phenomenon,  in  one  MITRE  cost  study 
it  was  found  that  a  contemplated,  new  command  and  control  system  would 
amke  it  possible  to  eliminate  the  survivability  requirement,  and  hence 
to  reduce  the  costs,  of  a  previously  approved  major  system. 

8.  3  Pats  Problems 

There  are  many  important  and  difficult  empirical  problems  associated 
with  estimating  the  system  non-funding  type  costs  discussed  in  Section  8.2 

8. 3. 1  The  _Ma*n  ltudc  Issue 

There  is,  first,  a  need  for  much  fuller  information  concerning  the 
relative  quantitative  significance  of  system  non-funding  type  costs  to 
t  e  total  military  decision  problem.  It  is  important  to  know  this 
information  because  the  potential  error  in  the  total  system  cost  estimate 
that  an  improper  handling  of  these  coses  can  cause  depends  to  a  large 
extent  on  the  relative  percentage  that  these  costs  represent  of  total 
system  costs. 

a.  Inherited  assets  and  salvage  values  are  a  case  in  point. 

It  is  known  that  the  Department  of  Defense  holds  title 

to  truly  tremendous  assets;  Secretary  of  Defense, 
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lobe rt  McNamara,  has  estimated  the  value  of  these  assets 

at  $200,000,000,000.  It  is  also  general  knowledge  that 

periooically  old  systems  are  retired,  new  ones  introduced, 

and  existing  systems  modified,  with  the  life  of  the  average 

system  probably  under  ten  years.  In  this  dynamic  situation 

there  is  certainly  some  transfer  of  assets  from  one  system 

to  another.  On  the  other  hand,  it  is  certain  that  some, 

maybe  many  of  these  system  assets  consist  of  highly 

specialised  equipment  with  a  aero  or  very  low  alternative 

use  value.  This  writer,  however,  has  been  unable  to  learn 

how  much  transfer  of  assets  in  the  aggregate  from  one  system 

* 

to  another  actually  occurs. 

b.  It  would  also  be  useful  to  have  a  "ball  park"  order-of- 

magnitude  estimate  on  the  relative  percentage  of  the  total 

Defense  budget  that  could  be  ascribed  as  direct  mission 

costs,  low  level  support,  intermediate  level  support,  and 

4 

high  level  support.  These  figures  would  give  a  general 
clue  concerning  the  relative  importance  of  accurately  esti¬ 
mating  the  support  costs  of  alternative  systems. 

Sr" 

Specific  cases  can  be  cited,  however.  For  instance,  $45,000,000  (original 
cost)  of  radar  and  related  equipment  released  by  the  Army's  Mike-Ajax 
system  was  distributed  among  a  host  of  different  agencies: 

Air  Force  Missile  Center,  Cape  Canaveral 

Naval  Ordnance  Test  Station,  China  Lake,  California 

Naval  Air  Test  Center,  Patuxent  River,  Maryland 

Naval  Research  Laboratory,  Washington 

Air  Defense  Engineering  Agency,  Fort  Meade,  Maryland 

NASA,  Ungley  Field,  Virginia 

NASA,  Wallops  Island,  Virginia 
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c.  Th«  importance  of  th«  military  personnel  component 
of  the  "fixed  supply**  type  of  asset  is  fairly  well 
established  in  the  broad  aggregate;  roughly  25X  of 
the  $50,000,000,000  Defense  Budget  is  for  military 
personnel  costa. 

8.3.2  Leek  of  Integrated  Records 

As  far  as  the  writer  knows,  there  is  at  the  present  time  no  compre¬ 
hensive,  centralised  program  -  official  or  unofficial  -  for  collecting 
much  of  the  specific  types  of  information  needed  for  estlsmting  the 
system-non-funding  costs  identified  in  Section  8.2.  There  is,  for 
instance,  no  centralized  program  within  the  Department  of  Defense  that 
summarises  what  Inherited  assets  are  potentially  available  to  a  proposed 
new  system,  that  Identifies  the  major  potential  competing  systenm  that 
could  use  given  assets,  and  estimates  the  "alternative  use"  value  of 
these  assets  to  each  of  the  potential  users. 

8. 3. 3  Dissemination  Problem 

There  are  also  practical,  administrative  problems  connected  with 

disseminating  this  non-funding  type  of  information  -  if  it  were  available - 

to  the  personnel  responsible  for  initially  generating  system  cost  estimates. 

The  alternative -use  costs,  high  level  support  costs,  spillover  costs,  and 

other  non-funding  costs  described  in  this  chapter  are  what  econaedsts  call 

"macro-economic”  data;  they  imply  an  Intimate  knowledge  of  the  total 

military  force  structure,  not  only  current  but  projected.  System  cost 

estimates,  on  the  other  hand,  are  initially  prepared  on  a  "micro5'  or 

relatively  low  echelon  level.  The  micro  analysts  normally  have  a  rather 

fragmentized  knowledge  of  the  macro  state  of  affairs,  and  it  would  tale 

some  major  realignment  in  such  considerations  as  "privilaged  information" 
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and  "need  to  know"  to  sake  this  macro- type  information  available  to  the 
micro  analysts,  even  assuming  that  higher  echelons  were  to  collect  and 
consolidate  it  in  a  fora  that  would  be  useful  as  inputs  to  the  individual 
system  cost  study. 

8.3.4  The  Meaningful  Data  Problea 

Answers  to  aany  of  the  cost  questions  raised  in  this  chapter  are 
inherently  elusive,  so  that  the  probleaa  even  in  the  long  run  of  obtain* 
ing  meaningful  data  are  great: 

8. 3.4. 1  Delayed.  Oblique  Costs.  The  cost  Uapacts  referenced  in 
this  chapter  are  often  delayed  and  oblique,  and  accordingly t  very  hard  to 
aaasure.  For  instance,  salvage  values  estimates  must  be  projected  5  to 
15  years  into  the  future  and  inevitably  are  enmeshed  in  great  uncertainties 
relative  to  the  nature  of  the  requirements  of  the  successor  system. 
Additionally,  in  a  strict  sense,  salvage  values  should  be  "discounted" 
to  present  value  before  incorporating  them  into  a  system  cost  estimate. 
However,  the  practical  prob learn  involved  in  selecting  defensible, 
empirical-oriented  discount  rates  are  formidable. 

Similarly,  support  cost  Impacts,  especially  high  level  support,  are 
oblique,  and  are  filtered  through  several  or  many  adadn 1 strati ve  echelons. 
Contrast  the  difficulties  in  measuring  these  types  of  cost  with  the 
relatively  immediate  and  straightforward  costing  of  the  construction  of 
a  direct  mission  building,  the  purchase  of  a  certain  piece  of  mission 
equipment,  or  the  hiring  of  direct  operating  civilian  personnel  for  a 
particular  system. 

g. 3.4. 2  Biased  Costs.  Another  data  complication  la  that  the  smjor 

potential  data  sources  for  the  'equired  information  are  both  highly 

subjective  and  inevitably  biased.  For  instance,  in  estimating  the 
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hU  "official" 


alternative  um  value  of  an  inherited  asset,  it  would  certainly  ba 
necessary  to  oltaln,  or  at  laast  check,  such  values  with  tha  potential 
uears  of  the  assets.  Howavar,  a  potantial  usar  la  likaly  to  formulate 
astiaata  of  tha  valua  of  an  Inherited  aaaat  to  hi*  in 
tarws  of  hia  political  atratagy  for  winuing  custody  of  tha  aaaat  in 
c  competition  with  othar  potantial  uaara. 

j 

Sladlarly,  in  aatlaatlng  tha  raaourca  inpact  of  a  naw  ay a tan  on 
certain  fixed  supply  or  ahared  aaaat?,  it  would  aeon  logical  to  request 


tha  agency  providing  the  aervice  for  a  atatenent  of  ita  ability  to 
abaorb  additional  workload  without  a  coanenaurate  Increase  in  ataffing. 
However,  it  would  be  naive  to  expect  an  unbiased  answer  froa  such 
agencies. 


8. 3. 4. 3  Hypothetical  Costa.  Apart  froai  the  natter  of  bias,  aany 
of  the  cost  inpact  questions  raised  in  this  chapter  are  basically 
hypothetical  or  conjectural,  rather  than  strictly  empirical.  For 
Instance,  the  "idle  capacity"  question  raised  in  the  case  of  fixed 
aupply  or  shared  assets,  provides  «  "field  day"  opportunity  for  specu¬ 
lation  as  to  what  would  be  the  level  of  utilisation  of  the  service  and 
the  quality  of  service  rendered  to  other  users  if  the  new  system  were 
not  introduced.  The  question  is  such  that  even  an  entirely  unbiased 
observer  vould  have  difficulty  in  formulating  inpersonal  answers. 

8.4  General  Ground  lules 

I 

8.4.1  Fremlsc 

The  very  serious  data  ptobleaw,  referenced  above,  awrkedly  limit 

the  ability  of  an  analyst  to  provide  in  a  planning  type  estimate  for 

tne  system  non-funding  type  costa  discussed  in  this  chapter.  However, 

in  this  connection  a  statement  by  Charles  B.  Hitch  is  relevant.  Xn 
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discussing  why  it  is  important  to  estimate  the  total,  rather  then  the 
partial,  cost  lsspact  of  a  system  he  said: 

While  the  accuracy  with  which  we  can  predict  such 
costs  oay  leave  something  to  be  desired,  it  is 
clear  that  at  least  trying  to  take  such  factors 
into  account  is  preferable  to  ignoring  them.* 

Although  the  probleas  of  Identification  and  amasurement  are  difficult, 
they  are  not  hopeless,  and  certain  guidance,  both  general  and  specific, 
can  be  suggested  as  a  atart  toward  a  set  of  principles  for  sys tenet ice lly 
handling  these  costs  in  a  planning  type  study.  The  general  guidance  will 
be  reviewed  first. 

i.4.2  Identification 

An  analyst  responsible  for  nailing  a  planning-decision  cost  estlnate 
should  be  acutely  alert  to  the  following:  one,  there  are  many  ways  in 
which  "real”  costs  can  be  generated  that  differ  fundanentaliy  f row  those 
included  in  a  funding  estisuite.  Two,  the  relevance  of  a  particular  type 
of  cost  to  a  systen  decision  and  the  desirability  of  taking  that  cost  into 
positive  consideration  is  not  necessarily  associated  with  the  ease  of 
amasurlng  that  cost.  Accordingly,  the  cost  analyst  in  estimating  a 
system's  cost  should  not  ignore  or  assume  a way  whole  areas  of  costs  merely 
because  they  are  hard  to  measure. 

If  the  analyst  discovers  or  suspects  certain  hard-to-measure,  po¬ 
tentially  significant,  oblique,  indirect  areas  of  coat  in  the  process 
of  bis  study,  he  should  Include  them  in  his  report  to  his  client.  If  he 
cannot  quantify  such  costa,  he  should  sake  a  descriptive  no:  >?  of  them. 

His  client  or  a  higher  echelon  nfflcij  if  alerted  to  them,  may  be  able  to 
quantify  them.  ... 
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Iv«n  if  these  indirect  cost*  cannot  be  quantified,  a  knowledge  of 
their  existence  say  still  be  important.  Thus,  if  two  system  alternatives. 


A  and  B,  offer  equivalent  total  effectiveness  ar.d  equivalent  monetary, 
funded  costs,  but  B  involves  substantial.  Indirect,  r on -funding  costs 
and  A  does  not,  A  would  bo  preferred. 

s.4.3  la&mmaL San  Sss&m 

It  will  bo  recalled  that  in  Chapter  2  the  point  was  made  that  in  a 
planning  type  estimate  it  is  appropriate  to  omit  certain  cost  elements 
when  the  omission  has  a  neutral  cost  impact  on  the  comparative  costs  of 
the  system  alternatives  under  consideration  and  on  the  decision  to  be 
made  Thus,  if  two  system  alternatives  would  involve  identical  research 
and  development  costs,  it  is  legitimate  to  omit  the  research  and 
development  costa  from  the  analysis,  and  to  make  the  decision  solely  in 
terms  of  the  comparative  Investment  and  operating  costs. 

This  way  of  looking  at  the  analysis  problem  has  been  generalised 
into  what  has  been  tensed  the  increamntal  cost  concept*,  and  it  provides 
a  useful  operating  criterion  in  deriving  planning  type  costing  estismtes. 

In  effect,  this  concept  states  that  a  planning  type  estiamte  should 

li  | 

include  only  the  incremental  costs  of  a  system  decision,  the  costs 

'll 

specifically  generated  by  the  system  decision  and  which  could  be  avoided 
if  it  ware  decided  to  forego  that  system  decision.  This  concept  stresses 
the  principal  of  "total  cost  impact"  rather  than  total  costs,  per  se. 

Sometimes  incremental  costs  are  simply  defined  as  future  costa. 
Strictly  speaking,  this  is  incorrect.  An  incremental  analysis  can  be 
made  in  which  the  previously  defined  system  capability  is  an  already 
approved  level  of  future  capability.  In  this  situation  the  costs  to 
cover  this  previously  defined  system  capability  would  not  be  incremental 
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cost*.  For  instance,  the  Secretary  of  Defense  may  have  approved  an 
expenditure  of  $50,009,000  for  FY  1965  to  cover  an  X  level  capability 
for  systea  462L.  He  My  request  an  increaental  cost  estiaate  to  help 
hia  decide  whether  the  rY  1965  expenditures  for  this  system  should  be 
increased  to  $75,000,000  in  order  to  increase  the  capability  of  the 
systea  tu  2X.  Although  the  full  $75,000,000  is  a  future  cost,  only 
$25,000,000  is  aa  increaental  ccat  in  this  particular  problem. 

One  of  the  practical  implications  of  an  incremental  approach  to 
costing  is  that  historical  or  sunk  costs  have  no  relevance  for  future 
decision  asking  purposes.  In  the  words  of  Hitch  and  McKean:  "Only 
future  sacrifices  are  relevant  -  not  past.  In  an  ecouoaic  calculus 
'bygones  are  forever  bygones. .It  is  only  the  extra  or  increaental 
cost,  noe  historical  or  *froa  scratch'  cost,  entailed  by  each  alternative 
systea  that  is  relevant  to  the  comparison^".  As  used  in  this  sense  a 

sunk  cost  refers  to  the  historical,  accounting  book-value,  procurement 

* 

coat  of  an  asset. 

8.4.4  Context  of  Problem 

j  i 

I  It  is  important  that  the  cost  analyst  recognise  that  the  context 

of  pis  problem  or  the  level  to  which  his  analysis  is  directed  can  im¬ 
portantly  influence  whether  in  a  particular  situation  an  incremental 
cost  does  in  fact  exist. 

When  the  problem  is  to  optiaise  some  design  detail  wl thin  the  con¬ 
text  of  a  given  system,  it  is  possible  to  neutralise  or  ignore  aany  more 
cost  elements  than  when  inter -system  comparisons  are  necessary.  When 
the  problem  la  one  of  intra-systea  analysis,  the  analyst  and  decision 

acker  can  skia  over  aany  cost  areas  in  which  the  alternative  configurations 

l 

have  equivalent  cost  impact  whether  these  areas  are  in  the  realm  of 
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Inherited  assets,  fixed  suppl)  assets,  spillover  effects  on  other  systems, 
anticipated  salvage  values,  high-level  support  costs,  or  direct  mlsaicn 
coats  In  other  words,  if  the  decision  has  already  been  made  to  proceed 
with  System  X  and  if  the  total  system  budget  has  already  been  substantially 
agreed  upon,  analysis  of  the  several  alternative  conf igurationa  can 
Justifiably  proceed  incrementally  by  concentrating  attention  on  the 
relatively  few  cost/effectiveness  trade-offs  aoong  sensitive  design 
areas,  l.e,  areas  in  which  the  various  configurations  differ.  However, 
the  determination  relative  to  identical  impact  should  not  be  made  lightly. 

However,  the  above  restricted  type  of  analysis  is  less  applicable 
as  the  scope  of  the  alternatives  under  consideration  widens.  Such  widen¬ 
ing  usually  occurs  as  one  proceeds  upward  in  the  administrative  hierarchy. 
When  the  scope  of  alternatives  is  widened,  costs  that  were  considered 
fixed  and  insensitive  in  an  intra-aystem  context  bee owe  variable  and 
sensitive.  Thus,  it  is  possible  for  instance,  that  research  and  develop¬ 
ment,  logistics,  training,  ami  high-level  support  costs  may  be  regarded 
as  insensitive,  neutral,  or  non- incremental  in  their  impact  when  two 
slightly  different  configurations  of  s  given  Air  Force  X  system  are 
being  evaluated  exclusively  against  each  other.  On  the  other  hand,  if 
the  analysis  is  broadened  to  rate  an  Air  Force  System  X  against  a  Havy 
System  Y  or  an  Army  System  Z,  or  if  a  command  and  control  system  is 
competitively  evaluated  against  a  weapon  system  as  a  means  of  enhancing 
the  nation's  total  military  posture,  it  becomes  necessary  to  have  a  much 
more  inclusive  cataloging  of  costa  and  to  give  greater  attention  to  the 
indirect  ways  in  which  an  incremental  cost  can  be  generated,  inducing 
the  system  non-funding  costs  discussed  in  this  chapter. 
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8.4.5  Documentation 


Careful  documentation  of  the  estimating  procedure  is  very  important 
when  an  incremental  approach  to  costing  ie  taken.  This  is  true  because 
Initially  snst  system  coat  estimates  are  prepared  at  lower  levels  of 
authority  where  a  relatively  narrow  range  of  alternatives  is  evaluated 
and/or  where  information  relative  to  such  things  as  alternative  users 
and  alternative  values  of  Inherited  assets,  potential  salvage  values, 
possible  spillovers,  appropriate  charges  for  shared  assets  or  fixed 
supply  assets,  etc.,  is  likely  to  be  very  lladted  or  erroneous.  Frequently, 
these  estiamtes  made  purely  for  intra-system  comparisons  are  either 
subsequently  reviewed  for  validation  or  used  as  a  basis  for  Intersystem 
comparisons  at  higher  levels  of  authority.  Since  some  of  the  incresmntal 
cost  assumptions  of  the  first  estimate  are  likely  to  be  invalid  or 
inappropriate  for  subsequent  analyses,  it  is  very  necessary  that  the 
documentation  of  the  initial  estimate  fully  reflect  how  all  costs  were 
treated. 

As  a  means  of  promoting  this  documentation  it  is  suggested  that 
planning  type  system  cost  estimstes  be  prepared  concurrently  on  both 
gross  and  net  bases.  The  gross  portion  would,  as  far  as  possible, 
estimate  the  costs  of  a  system  independent  of  any  inheritance,  sharing, 
or  side  affects  with  or  on  other  systems.  All  mission  assets  would  be 
costed  at  their  purchase  price.  The  net  portion,  on  the  other  hand, 
would  take  full  cognisance  of  possible  cost  impacts  that  this  system 
adght  have  on  and  with  other  systesm.  Consideration  would  be  given  to 
the  possibility  of  inheriting  assets  from  other  systems  and,  to  the 
extent  that  data  were  obtainable,  the  inherited  assets  would  be  costed 
at  their  alternative  use  value.  An  attempt  would  be  made  to  estimate 
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the  variable  costa  attributable  to  tha  system  from  assets  or  services 
shared  with  other  systeas.  Any  known  or  speculated  re percua alone  in 
tha  fora  of  spillovers  and/or  salvage  values  would  also  be  included. 

If  it  were  laposslble  to  quantify  these  inherited,  shared,  spillover, 
or  salvage  costs,  tha  estlaata  would  be  explicitly  docuaanted  to 
reflect  the  possible  or  probable  existence  of  such  costs  with  tha 
notation  diet  It  had  been  impossible  to  quantify  thea. 

The  advantage  of  this  gross-net  type  estimate  la  diet  It  would 
allow  die  office  originating  the  estlaata  to  asks  any  assuaptlona 
that  it  considered  reasonable  In  arriving  at  an  estlaata  of  the  systeaf 
cost,  while  concc-rently  giving  each  succeeding  reviewing  echelon  the 
full  costing  rationale  employed  by  the  lower  echelon.  This  approach 
would  also  provide  succeeding  echelons  with  sow  of  die  basic  data 
needed  to  correct  al stakes  In  lower  echelon  assuaptlona  or  estimates 
or  to  realign  the  original  estimate  to  fit  a  different  context  or 
different  type  of  decision. 

8.4.6  Specific  Guidance 

To  promote  a  generally  consistent  and  explicit  application  of  the 
increaental  costing  principle  by  all  cost  analysts  it  is  desirable  that 
a  set  of  specific  operating  principles  be  developed.  Illustrative  of 
die  type  of  guidance  referenced  is  the  following: 

a.  The  Air  Force  has  ~rovided  official  planning  guidance 
to  help  estimate  the  lower  level  support  personnel 
and  related  resource  requirements  for  standard  Air 
Force  organisational  units.®  The  specific  cstiaating 
relationships  provided  in  these  published  sources  can 
be  used  to  calculate  some  of  the  support  costs  ref¬ 
erenced  in  this  chapter. 
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b.  In  keeping  with  the  oppcrtvnity  cost  or  alternative 
uaa  principle,  an  inherited  aaaet  should  be  costed 
free  (no  cost)  to  a  new  systea  If  there  are  no 
alternative  users  for  that  asset. 

c.  If  an  Inherited  asset  has  aultlple  alternative  uses, 
the  asset  should  be  costed  at  its  highest  alternative 
use  value  when  this  asset  is  Included  within  the 
configuration  of  a  planning  type  cost  study. 

For  exaaple,  as suae  that  an  asset  acquired  for  Systea  A  at  an 

original  cost  of  $3,000,000  is  being  released.  Three  (3)  new  allltary 

aysteas  B,  C,  and  0,  each  could  aake  use  of  this  asset  as  opposed,  in 

each  instance,  to  acquiring  a  cooper able  new  asset.  A  fourth  alternative 

is  to  sell  the  asset  to  a  private  source  for  $4,000,000. 

"Value"  of  Systea  A  Asset: 
(l.e..  Difference  between 


Svstea 

Coat  to  Purchase 
Mew  Asset 

Coat  to  Refurblah 

A  Modify  Syatea 
"A"  Asset 

» —  - - m  — -  - 

the  Purchase  Price  of  a 

Hew  Asset  and  the  Refurnlshinj 
Modification  Costs  of  the 
Inherited  Asset) 

B 

4,000,000 

2,000,000 

2,000,000 

C 

8,000,000 

3,000,000 

5,000,000 

D 

10,000,000 

7,000,000 

3,000,000 

SALE  PRICE 

4,000,000 

The  appropriate  cost  to  establish  for  the  inherited  asset  when  used  in 
one  particular  eaployaent  is  die  value  that  die  asset  would  have  if  the 
aaaet  were  used  instead  in  its  nost  productive  (highest  value)  alternative 
eaployaent.  Thus,  if  the  Systea  A  asset  were  aade  available  to  Systea  B 
or  D,  it  would  be  costed  at  $5,000,000  because  the  highest  alternative  use 
is  in  Systea  C  which  is  valued  it  $5,000,000.  On  the  other  hand,  if  die 
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Ijritnc  A  sim:  wore  ui«d  la  Jystae  C,  11  would  U  valued  at  $4,000,000  - 
tha  poaaibla  tala  prlca  to  a  prlvata  sourca,  tha  high* at  alternative  uaa 
valua.  (Mote:  Tha  foregoing  exeaple  la  not  Intended  to  suggest  which  of 
tha  eoapetlng  systeas  should  In  fact  get  tha  lnharltad  aaaat.  Th*  axaapla 
a*  rely  atteapts  to  provide  a  systematic  baala  for  determining  how  tha 
aaaat  ahould  ba  coatad  if  it  wara  uaad  in  ona  way  va.  anochar.) 
d.  If  System  A  Inherit*  an  aaaat  froai  a  discontinued 
Systea  B  or  draws  auch  aaaat  fro*  tha  Inventory  of 
a  currant  Syataa  C,  that  aaaat  ahould  ba  coatad  to 
Syataa  A  at  approxlaately  Ita  currant  procuraaant 
coat  If  auch  aaaat  la  on  currant  or  acheduled 
procuraaant  for  Systems  C.  0,  or  K.  Appropriate 
allowance  ahould,  of  couraa,  ba  aada  for  tha  con¬ 
dition  of  the  aaaat  that  Syataa  A  inherit*, 
a.  Unleae  the  analyat  has  evidence  of  either  Midle 
capacity**  or  an  unusually  tight  supply  in  tha 
reala  of  designated  shared  assets  or  fixed  supply 
assets,  a  new  syataa  should  be  charged  for  these 
assets  In  proportion  to  Its  use  of  these  assets. 

Thus,  if  Syataa  A  and  Syataa  J,  are  being  evaluated 
as  alternatives  to  satisfy  a  given  requirement,  and 
Systea  A  requires  5,000  allitary  personnel  of  a 
given  type  and  Systea  B  500,  Systea  A  ahould  ba 
charged  approximately  10  tinea  as  auch  for  allitary 
personnel  as  Systea  B.  In  each  ease  tha  charge  per 
aan  will  be  that  represented  by  the  pay,  allowance, 
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And  related  fringe  benefit  costs*. 

8.5  Suaaary 

This  chapter  focuses  ro  the  fact  that  many  true  costs  of  a  systesi 
decision  ere  not  fully  reflected  In  the  aoney  flows  associated  with 
funding  a  systea. 

These  systea  non- funding  costs  arise  when  a  systea  Inherits  soae 
of  its  required  resources  froa  other  systeas,  or  shares  soae  of  its 
required  resources  with  other  systeas,  or  uses  resources  that  are  funded 
on  a  consolidated  (non -systea)  basis,  or  bequeathes  certain  valuable 
assets  to  successor  systems,  or  Indirectly  causes  other  changes  in  the 
costs  of  ocher  systeas. 

The  task  of  identifying  and  saasuring  these  indirect  costs  Is 
seriously  hampered  by  eapirical  probleas. 

la  seeking  to  surmount  these  data  probleas  and  in  estimating  these 
indirect  costs,  the  incrcamntal  cost  concept  serves  as  a  useful  criterion. 
This  principle  seeks  to  isolate  the  specific  additional  costs  attributable 
to  a  specific  systea  decision;  it  rejects  historical  notions  of  cost  such 
as  book-value  or  sunk  costs. 

The  chapter  provided  lllustrstive  guidance  for  identifying  and 
aeasurlng  the  real  incremental  cost  impact  of  a  particular  systea 
decision. 


Soae  methodologists  argue  that  die  respective  desands  of  the  two  systeas 
for  ailitary  personnel  should  not  be  converted  to  monetary  terms.  This 
position  has  particular  relevance  when  there  is  a  decided  unbalance  in 
the  total  supply-demand  position  of  die  asset  in  question. 
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CHAPIPt  9 


msnrrnic  thi  estimate 

9. 1  Objectives 

Basically  in  presenting  his  findings  the  cost  analyst  aust  be  nind- 
ful  of  two  considerations.  First,  it  is  important  that  the  findings  of 
the  study  be  communicated  in  as  aeaningful  and  as  effective  fashion  as 
possible.  Second,  it  is  necessary  to  take  precautions  to  insure  that  the 
cost  estimate  is  not  ads interpreted  or  misused. 

9.2  Froblama 

9.2.1  Bole  of  Uncertainty 

Moat  of  the  problems  associated  with  pvertnting  the  results  of  a 
coat  study  can  be  traced  to  die  tremendous  uncertainties  that  a  cost 
analyst  has  to  contend  with.  He  can  rarely  find  out  as  much  as  he  would 
lifca  to  know  about  the  specifications  of  the  requirement  he  is  costing. 
Additionally,  he  finds  it  difficult  to  secure  cost  data  that  is  either 
quantitatively  or  qualitatively  adequate.  Accordingly,  when  he  derives 
a  cost  estimate  for  a  specific  system  element  or  an  entire  system,  die 
estimate  is  normally  honeycombed  with  a  myriad  of  assumptions,  some  more 
verifiable  than  others.  Moreover,  if  he  were  to  change  any  of  these 
assumptions,  his  cost  estimate  would  also  change.  Therefore,  if  he  tries 
to  take  account  of  these  assumptions  in  his  cost  eetimste,  he  will  end 
up  not  with  one  estimate,  but  with  several  or  many,  depending  upon  which 
assumptions  prevail. 

9.2.2  Tendencies  to  Deeaphaslsa  Oncer tain tv 

Sometimes  another  problem  to  effective  communication  between  the 
coat  analyst  and  his  client  is  a  mutual,  tacit  tendency  on  the  part  of 
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both  of  them  to  deeaphasiae  the  limitations  and  uncertainties  in  an 
estimate.  The  client  as  a  decision  aaker  in  choosing  among  alternative* 
find*  it  easier  to  work  vitn  a  single  value  answer  and  he  find*  it  aore 
difficult  to  reach  clean-cut  decision*  if  he  has  to  take  into  consideration 
aany  qualifications  to  a  cost  as t lasts,  especially  if  these  qualifications 
are  stated  descriptively  rather  than  quantitatively.  On  t'e  other  hand, 
although  the  cost  analyst  does  not  went  to  ovsrseli  the  validity  and  re¬ 
liability  of  his  estimate,  at  the  saaa  time  he  has  a  human  inclination 
not  to  depreciate  its  worth  too  greatly,  especially  if  he  has  worked 
hard  to  estiaate  the  cost  of  a  difficult  requirement. 

9L.2.3  A  Tolltlcal-Adainlatratlve  Constraint 

Another  problca  to  objective  reporting  is  the  fact  that  system  cost 
estimates  are  frequently  generated  in  a  semi-political  atmosphere.  That 
is  most  system  cost  estiaates  are  prepared  us  ona  adjunct  of  a  broader 
system  analysis  study  or  proposal.  To  win  progr  arfng  and  funding  ap¬ 
proval  from  higher  administrative  and  legislative  echelons  of  authority, 
these  proposals  must  be  "sold”  on  a  coet/effect iveness  basis  in  competition 
with  other  system  proposals.  Therefore,  when  great  uncertainty  exists  as 
to  a  system's  most  probable  cost,  the  cost  analyst  aay  find  that  his 
client,  if  under  strong  pressure  to  sell  his  program,  will  take  as  his 
single  estimated  value  the  lower  end  of  a  range  of  possible  values  de¬ 
rived  by  the  analyst.  Especially  in  thediort-run,  there  is  relatively 
little  that  the  cost  analyst  can  do  to  prevent  such  misuse  of  bis  findings. 

9.2.4  Subsequent  Misuse 

Many  of  the  most  serious  misuses  of  cost  estiaates  arise  from  die 

fact  that  the  estiaate  frequently  bee ones  a  data  input  to  later  studies. 
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Thus,  although  the  estimate  nay  have  been  valid  in  its  original  applica¬ 
tion,  it  ia  frequently  much  leas  ao  in  ita  later  applications.  The  po¬ 
tential  danger  of  such  misapplication  increases  with  the  reputation  of 
the  analyst  since  subsequent  users  of  an  estimate  are  most  likely  to 
accept  the  ectiaate  of  a  recognised  expert  without  inquiring  sufficiently 
into  its  relevance  in  a  new  situation. 

9. 3  General  Cround  Rules 

In  aany  respects  the  probleas  that  a  cost  analyst  has  in  conmunlcat- 
ing  his  findings  co  his  client  are  characteristic  of  those  existing  in 
■»st  adviser-client  situations  in  the  world  at  large.  Also,  certain 
basic  ground-rules  are  generally  applicable  for  Inproving  such  communica- 
tion: 

9. 3. 1  Pocuaantatlon 

It  is  very  taportant  that  the  cost  analyst  neticulously  follow  all 
of  the  nonsal  rules  of  good  reporting  such  as  carefully  stating  the 
assumptions  and  qualif ications  on  which  his  estimate  is  based  and  clearly 
defining  the  terns  and  concepts  he  uses.  The  time  pressures  to  which 
the  analyst  is  subject  in  completing  his  report,  sometimes  make  it 
difficult  to  comply  with  this  guidance. 

9.3.2  Strategy  in  tenor  ting 

The  choice  of  the  particular  medium  to  present  this  supporting  in¬ 
formation  is  very  inportant.  If  possible,  the  most  critical  qualifica¬ 
tions  should  be  incorporated  with  the  estimate,  itself,  as  an  Integral 
part  of  die  main  body  of  the  report.  If  relegated  to  an  obscure  appendix 
of  die  report,  they  are  apt  to  be  overlooked  or  ignored. 
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The  cost  findings  will,  of  course,  b«  most  assnlngful  to  the  client 


if  they  arc  axpresrly  geared  to  fit  his  specific  application  of  the 
estimate.  Among  other  things,  this  naans  that  the  output  tables  (ftlenant 
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eatlaates)  and  the  narrative  portion  of  the  study  should  normally  foe 
attention  on  the  largest  and  nost  cost-sensitive  eleasnts. 

Xn  this  regard,  the  study  should  note,  if  pertinent,  the  extent  to 
which  the  systen  cost  would  be  affected  if  the  systen's  developnant  and 
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acquisition  were  either  conpressed  or  stretched  out  tine-wise.  For  instance, 

*  jl-'  I 

certain  costs,  such  as  systen  nanagenent,  nay,  to  sown  extent,  be  a 

function  of  the  tine  period  over  which  they  are  spread,  whereas  otheri 

j 

such  as  mission  equipment,  nay  be  relatively  insensitive  to  the  tine  ; 

] 

factor. 

Likewise,  some  cost  eleannt  estinstes  are  nore  perishable  (require 
sure  frequent  review  and  updating)  than  others.  Certain  types  of  squip- 
nent  naintenance,  where  new  developennts  in  technology  nay  be  a  considera¬ 
tion,  are  an  example  of  such  data  perishability.  Because  any  study  nay 

i 

subsequently  be  used  as  a  base  for  later  studies,  and  sonatinas  without 
the  knowledge  of  the  analyst  who  did  the  original  study,  it  is  well  to 
label  the  sx>st  perishable  types  of  data.  j 

9.3.4  Standardised  legorting  Procedures 

Standardising  cost  formats  and  element  definitions  from  systen  to 

systen  and  from  one  costing  project  to  another  also  contribute  to  nori 

! 

meaningful  connunication  between  the  cost  analyst  and  his  client, 
especially  if  there  are  repeated  contacts  between  the  analyst  and  the 

i 

sane  client  on  different  projects. 

159 


9. 3. 5  Standardised  Cone apt a 

Since  costing  concepts,  such  es  those  used  In  handling  inherited 
assets  and  support  services,  can  sotaetiaee  be  Manipulated  to  achieve 
large  differences  in  cost  estifrstes,  It  is  desirable  (hat  certain  ground- 
rules  relative  to  concepts  be  adopted  in  the  interest  of  better  analyst- 
client  understanding  Pint,  as  in  the  case  of  elenent  definitions,  it 
Is  desirable  that  to  the  maximum  extent  possible,  these  concepts  should 
be  standardised.  Second,  it  would  be  useful  to  have  a  succinct  statenent 
of  these  concepts  as  a  standard  attachaent  to  all  cost  estiutes.  This 

I  j 

C  taunt  should  also  referenca  Mora  detailed  Methodological  literature 
^  t  would  further  explain  the  rationale  of  the  concept.  Finally,  the 
nain  body  of  the  narrative  report  covering  an  eatlaate  should  explicitly 
note  end  explain  any  deviations  from  these  standard  concepts  that  nay 
have  been  used  in  that  particular  study. 

A  partial,  illustrative  listing  of  standardised  costing  concepts  and 

ground-rules  that  Might  appear  in  a  typical  cost  study  are  provided  below: 

$ 

1.  Purposes  of  the  Study: 

a.  To  estlaate  the  total  resource  drain  for  each  of  the 
'l  designated  ays  tens  options  that  would  ha  incurred 

during  the  period  FT  19X1  to  PY  19YY. 
b.  To  estlaate  any  savings.  If  any,  that  would  resul. 

froa  lapleaenting  these  options  during  FT  19XX  to  FT  19YY. 

2.  Costing  Ground -lulas: 

a.  This  study  is  based  on  a  total  activity  costing  con¬ 
cept  in  the  sense  that  it  Includes  all  type  coats, 
direct  and  indirect,  attributable  to  the  development, 
acquisition,  and  operation  of  each  of  the  designated 
ays tea  options. 
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b.  However,  cotes  ere  increnentsl  in  the  sense  chat 
only  ehosc  specific  costs  are  included  that  can 
be  Identified  to  this  particular  systea;  i.e., 
only  those  costs  that  would  be  eliminated  if  it 
were  decided  to  forego  this  system. 

c.  The  coses  specifically  excluded  from  this  estimate 
include  the  following: 


d.  Costs  are  expressed  in  undiscounted,  196X  dollars. 

e.  The  time-phasing  of  costs  is  by  fiscal  years  in 
which  obligational  authority  is  believed  needed 
for  cooaitaent  of  funds. 

f.  The  general  system  description  and  the  appropriate 
schedules  for  each  system  option  are  contained  in 
Section  ZY. 

g.  The  estimates  do  not  include  any  factor  for  futura 
improvements  to  provide  performance  capability  in 
excess  of  that  specified  in  Section  XT,  etc. 

9.3.6  Merchandising  the  Report 

The  cost  analyst  usually  faces  a  problem  in  merchandising  his 
findings  since  traditionally  scientific  and  economic  writings  are 
dull  reading  to  non-specialists.  Considering  this  ha sard  and  without 
sacrificing  the  advantages  of  standardised  reporting  procedures  and 
formats  discussed  previously,  it  is  well  for  the  analyst  to  tailor 
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his  presentation  to  hia  client's  background  and  preferences  relative  to 
such  things  as  technical  vs.  non- technical  exposition,  the  use  of  graphic 
Material  and  visual  aids,  extensive  tables  of  supporting  data,  etc. 

9. 3. 7  Estimating  Qaittcd  Elenente 

Frobleas  in  securing  data  or  a  shortage  of  tisu  to  complete  an 
estlaute  asy  soaetiaes  oblige  an  analyst  to  omit  certain  relevant  ele- 
aents  froa  a  systea  cost  estiaete.  As  indicated  previously,  such 
oaisslons  should  be  clearly  noted  in  the  assuaptiona  and  qualifications 
to  the  estimte.  However,  the  client's  understanding  would  be  improved 
if  the  analyst  were  to  give  his  best  guess  based  on  whatever  research 
he  had  done  as  to  the  relative  order-of -Magnitude  of  the  oadtted  costs 
vs.  the  included  costs.  An  adjective  cooper ison  would  be  helpful  such 
as  the  "omitted  costs  are  considered  to  be  minor  (or  aajor)  as  coopered 
to  the  included  costs."  A  quantitative  estimate  would  be  even  sure 
helpful  such  as  "the  oaitted  costs  are  roughly  estlaated  to  approximate 
25  to  50  per  cent  of  the  included  costs." 

9.3.8  Anticipating  Mew  Applications 

Similarly,  because  of  the  client's  particular  application,  aany 
systea  cost  estimates  are  partial,  rather  than  total,  activity  estiaates. 
Future  misapplications  of  such  partial  estimates  could  be  avoided  if  the 
original  estimate  were  to  be  specifically  annotated  with  an  order-of- 
magnitude  estimate  of  the  oadtted  costs  that  night  be  relevant  if  the 
original  estimate  were  to  be  used  for  a  different  plausible  purpose,  e.g. , 
planning  vs.  funding.  For  instance:  "The  costs  shown  for  the  designated 
airborne  command  systea  are  funding  oriented  and  should  be  appropriately 
adjusted  if  it  is  decided  to  m?  these  figures  in  evaluating  this  system 
competitively  against  other  systems.  In  this  case  there  should  be  added 
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to  the  total  funding  estimate  of  $  X  Million  a  charga  of  $  Y  Million  to 
covar  aircraft  that  this  alrboma  command  System  A  would  'inherit'  or 
aacura  fro*  weapon  Systaa  B. " 

Xn  this  connactlon  It  la  ralatlva  to  reference  tha  discussion  of 
Chapter  2  concarnlng  *rha  1  ana d lata,  lntaraadlata,  and  ultlaata  cllanta 
of  tha  coot  analyst  on  a  givan  costing  projact.  Frequently,  tha  aoat 
valuabla  contribution  of  tha  cost  analyst  to  his  laaodiato  cliant  will 
coast  through  personal,  verbal  contact  or  through  informal  memor and i 
long  before  tha  final  report  is  written,  especially  if  tha  cost  analyst 
is  a  member  of  a  systaa  design  teas  and  if  he  haa  node  cost 
sensitivity  studies  to  help  guide  the  design  effort.  Xn  such  cases  the 
final  narrative  report  aay  be  a  fonaality  that  documnts  for  tha  file 
all  Information  that  die  analyst  and  client  have  exchanged. 

However,  even  in  such  cases  the  final  report  is  still  extremly 
important  for  two  reasons.  Frequently,  the  immediate  client  haa  to 
submit  his  own  broad  system  analysis  study  through  several  or  many 
echelons  in  the  process  of  securing  official  approval  for  the  program. 

A  carefully  documented  cost  report  is  extremely  valuable  to  subsequent 
echelons  in  making  their  evaluations  of  the  system  proposal. 

Second,  well  documented  cost  reports  on  particular  system  studies 
are  the  basic  foundation  of  a  centralized  data  base  system.  Without 
such  careful  documentation,  it  is  almost  impossible  to  use  past  studies 
as  a  basis  for  future  cost  estimates. 

9.3.9  Hulti-Val  »e  Estimates 

As  indicated  previously,  many  of  the  problems  associated  with  pre¬ 
senting  the  results  of  a  cost  study  can  be  traced  to  the  tremendous 

uncertainties  that  a  cost  analyst  has  to  contend  with.  Because  of  this 
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the  coat  analyst  in  presenting  his  findings  really  has  a  twofold 
obligation  to  his  client.  One  is  to  sake  an  intelligent  estimate  as  to 
what  the  cost  of  a  new  system  is  most  likely  to  be.  His  second  obligation 
is  to  provide  sosk  inkling  relative  to  what  the  chances  are  that  this 
best  estlaate  will  be  seriously  wrong,  and,  if  it  is  wrong,  in  what 
direction  and  of  what  Magnitude  the  error  is  likely  to  be.  Chapter  7 
in  discussing  uncertainty  presented  various  Methods  of  coesunlcatlng 
this  type  of  infornstion  to  the  client. 

Chapter  7  also  mentioned  that  the  analyst  could  use  adjective 
descriptors,  such  as  "strong  possibility,"  "very  unlikely,"  "fair 
chance,"  etc.,  to  convey  the  degree  of  uncertainty  he  felt  existed 
in  the  estisete.  Alternatively,  he  could  use  numerical  probabilities 
such  as  .8,  .95,  etc.,  to  bracket  a  range  of  estimates.  Although  at 
tines  the  analyst  nsy  feel  that  his  knowledge  is  simply  not  sufficiently 
precise  to  use  numerical  probabilities,  whenever  his  infornstion  is 
adequate,  he  should  use  die  numerical  probability.  It  has  been  established 
that  large  differences  exist  among  people,  even  among  system  analysts, 
relative  to  the  meanings  attached  to  adjective  descriptors.  In  other 
words,  the  chances  of  misinterpretation  are  substantial  when  adjective 
descriptors  are  used. * 

9. 3. 10  Avoiding  Pseudo  Accuracy 

The  cost  analyst  can  also  help  to  cosmsmicate  his  uncertainties  to 

his  client  by  the  precision  with  which  he  reports  his  data.  The  practice 

of  reporting  very  precise  numbers  connotes  a  pseudo  accuracy  because  it 

implies  a  depth  and  precision  of  knowledge  that  in  most  cases  simply  does 

not  exist.  Thus,  sub-elements  should  not  be  reported  to  the  nearest 

thousand  of  dollars  when  the  total  system  costs  amount  to  hundreds  of 

164 


all liens  or  billions  of  dollars.  In  effect  the  analyst  should  round  off 
his  figures  in  a  way  that  highlights  die  normally  treaendoua  uncertainties 
that  underlie  his  findings  rather  than  caaouflage  then. 

This  prescription  relative  to  avoiding  pseudo  accuracy  in  reporting 
my  appear,  superficially  at  least,  to  contradict  the  suggestion  node 
previously,  to  use  numerical  rather  than  adjective  descriptors  to 
communicate  uncertainty.  Basically,  there  is  no  contradiction.  The 
practice  should  be  to  fit  the  presentation  technique  to  fit  the  character 
of  the  data  to  be  presented.  Thus,  if  the  analyst  has  sufficiently  good 
information  to  be  precise  in  his  presentation,  ha  should  be  precise.  In 
particular,  nuaerlcal  statements  are  less  subject  to  misinterpretation 
than  adjective  descriptors.  However,  if  his  information  is  not  precise, 
he  should  not  pretend  it  is. 

9.3.11  Oses  and  Abuses  of  Statistics 

Finally,  if  the  cost  analyst  and  his  client  are  to  comsunlcate  more 
meaningfully  and  if  they  are  to  use  the  cost  findings  Intelligently  as  a 
tool  to  decision  making,  both  the  analyst  and  his  client  should  becoase 
aware  of  the  most  common  misuses  of  statistics.  Such  knowledge  is  rela¬ 
tively  easy  to  acquire  since  in  recent  years  a  number  of  lucidly  *  rltten 

books  keyed  to  the  level  of  the  administrator  and  the  non-professional 

2 

statistician  have  been  written  on  this  subject. 

examples  of  statistical  areas  in  which  the  analyst  and  client  should 

both  be  knowledgeable  include  the  following: 

Correct  and  Incorrect  Uses  of  Percentages 

Common  Errors  in  Classifying  Data 

Uses  and  Misuses  of  Graphic  Techniques 

When  to  Use  the  Mean,  Median,  and  Mode 
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* imple  Measures  of  Dispersion 
Dos  sod  Don'ts  of  Sampling 
Correct  end  Incorrect  Uses  of  Index  Busbars 
Horae 1  end  Other  Distributions 
Irrors  of  Interpolation  end  Extrapolation 
Correlations,  Cause  and  Effect 
The  Proper  Hole  of  Confidence  Intervals  and 
Bow  to  Calculate  Then 
Pitfalls  in  Calculating  Probability 
9.4  guvarv 

The  responsibilities  of  the  cost  analyst  do  not  end  when  he  has 
finally  derived  the  estimated  cost  of  his  system.  Be  must  also  co— ml- 
cate  his  findings  to  his  client  in  as  meaningful  a  fashion  as  possible 
and  take  whatever  precautions  he  can  to  minimize  a  misinterpretation  or 
misuse  of  these  findings  either  by  his  client  or  by  subsequent  users. 

The  most  general  and  probably  the  most  important  thing  that  the 
cost  analyst  can  do  to  avoid  a  misinterpretation  of  his  findings  is  to 
follow  meticulously  all  of  the  normal  rules  of  good  research  reporting 
such  as  documenting  all  assumptions  and  qualifications  and  carefully 
defining  all  concepts  and  terms.  The  most  important  part  of  this 
information  should  be  incorporated  into  the  body  of  the  report  rather 
than  relegated  to  an  appendix  where  it  would  more  likely  be  overlooked. 

All  tabular  and  narrative  material  should  be  expressly  geared  to 
answer  the  specific  questions  that  follow  from  the  client's  intended 
application  of  the  estimate  and  to  highlight  the  largest  and  most 
sensitive  cost  elements. 
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Standardised  cost  formats,  definitions,  ind  concepts  from  system  to 
systesi  and  from  project  to  project  will  minimise  potential  areas  of  con¬ 
fusion  and  sdsunder standing. 

To  the  extant  that  he  can,  the  coat  analyst  should  Include  in  hia 
study  an  order- of -magnitude  adjustment  that  would  be  applied  if  his 
estimate  mere  to  be  used  for  other  different,  but  related,  purposes. 

Benges  of  estimates  with  a  probability  distribution  attached  to 
various  intervals  of  the  range,  as  opposed  to  a  single  expected  value 
estlsmte,  are  a  useful  means  of  conveying  uncertainty  to  the  client. 

The  total  system  cost  estimate  plus  that  of  individual  elesmnts 
should  be  rounded  appropriately  to  highlight,  rather  titan  camouflage, 
the  uncertainties  pervading  the  data  underlying  the  estimate. 
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*An  SBC  study  revealed  Mazing  differences  in  the  waning*  (nuaerical  164 

probabilities)  associated  vlth  cowoo  verbal  phrases  such  as  ’’highly 
probable,"  "fair  chance,"  "soaswhat  unlikely,"  etc.,  S.  C.  Lichtenstein 
sad  J.  K.  Wairasn,  "Eapirlcal  Scaling  of  Coaaoo  Verbal  Phrases  Associated 
With  Huaarlcal  Probabilities,"  Systea  Bevel opsant  Corporation,  Technical 
Heaorandua  1150/002/00  (28  June  1963). 

^Por  instance:  W.  0.  Reichaan,  Use  and  Abuse  of  Statistics  (Oxford  165 

University  Press,  1961);  Hans  Zeisel,  Say  It  With  Figures  (Harper  6 
low,  1957);  W.  A.  Wallis  &B.  V.  Roberts,  Statistics.  A  Hew  Approach 
(The  Free  Press,  1959)  Ch.  2  A  3. 
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CHAPTER  10 


USING  TOE  COST  ESTIMATE  AS  A  DECISION -HA ICING  TOOL 


10. 1  Purpose 

This  study  has  sought  primarily  to  show  how  tha  explicit,  non-personal 
methodology  so  successfully  used  in  the  hard  sciences  can  be  employed  to 
estimate  more  accurately  the  costs  involved  in  developing,  acquiring,  and 
oper^f^nq  a  military  system.  The  present  chapter  is  in  a  sense  an  epilogue 
to  the  previous  chapters  in  that  it  discusses  s  broader  and  perhaps  more 
basic  issue,  naamly,  where  do  the  responsibilities  of  the  analyst  begin 
and  end?  In  other  words,  do  the  potentialities  for  systematic  analysis 
er.J  with  the  derivation  and  presentation  of  the  cost  estimate?  Must  the 
larger  prqblema  of  choosing  the  system's  goals  and  aelecting  the  preferred 
alternative  for  meeting  these  goals  be  left  entirely  to  the  intuitive 
juigrent  of  the  client,  or  can  the  analyst  help  the  client  systematically  to 
resolve  these  larger  problems? 

In  recent  years  the  movement  to  apply  systematic  analysis  to  the 
total  military  system  decision  problem  has  proceeded  rspidly  under  many 
guises  -  operations  research,  system  analysis,  managers nt  science,  etc. 
Currently  a  frequent  appellation  for  this  type  of  methodology  f.s  cost/ 
effectiveness  analysis.  Our  objective  here  is  not  tt<  cover  the  methodology 
of  cost/effective  analysis;  it  would  take  ■  full-length  book  do  that 
adequately,  lather,  the  objective  of  this  chapter  is  to  explore  briefly 
in  whet  ways,  direct  end  indirect,  the  influence  of  the  coat  analyst  may 
be  felt  on  the  client's  choice  of  goals  and  system  alternatives  to  meet 
these  goals. 
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It  should  be  stressed  that  the  discussion  thst  follows  is  aimed  sure 
et  being  selectively  prescriptive  rather  than  generally  descriptive.  In 
other  words,  it  io  not  Intended  to  recapitulate  the  responsibilities  that 
historically  cost  analysts  have  had. 

Thus,  frequently  either  the  characteristics  of  the  problem  being 
analysed  or  the  administrative  ground* rules  of  the  project  prevent  the 
cost  analyst  from  providing  the  type  of  service  to  his  client  described 
below.  In  sons  cases  the  client  knows  exactly  what  his  goals  are,  he 
has  completely  Identified  his  possible  system  alternatives,  and  the  system 
study  shows  that  one  alternative  is  so  clearly  superior  to  the  others  th^t 
the  client  needs  no  sophisticated  methodology  to  help  him  make  his  choice. 

In  other  cases  these  smtters  may  not  be  so  clear-cut,  but  either  lisdtariona 
of  time  to  complete  the  project  or  a  client's  preference  to  keep  these 
responsibilities  entirely  unto  himself  limit  the  cost  analyst's  contribution. 
The  following  discussion  applies  when  neither  these  inherent  or  contrived 
constraints  prevail. 

10. 2  Establishing  Objectives 

10.2.1  Firming  Op  Goals 

As  a  member  of  an  inter-discipline  system  analysis  team  the  cost 

analyst  can  sometimes  contribute  Importantly  to  establishing  the  goals 

of  a  project.  In  the  first  place,  the  client  frequently  has  only  vague, 

and  sometimes  conflicting,  notions  regarding  his  requirements  when  he 

first  requests  an  advanced  systems  study.  It  is  part  of  the  analyst's 

responsibility  to  extract  from  the  client  and  to  develop  with  die  client 

a  definitive,  consistent  statement  of  these  goals  and  to  translate  these 

generally  stated  mission  goals  into  specific  performance  attributes. * 
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This  translation  demands  a  high  level  analytical  capability  for 
several  reasons.  One  is  that  in  die  Military  systeae  field,  especially 


electronic  comma ad  and  control  systems,  the  systea  performance  perasettars 
are  generally  expressed  in  nebulous,  qualitative  teras  such  as  flexibility. 


are  gi 

growtl 


growth  potential,  consistency  of  response,  etc.  These  teras  must  be  defined 
meaningfully  both  within  the  context  of  the  particular  mission  and  also 

I 

consistently  to  reflect  the  higher  level  national  goals  that  the  particular 
mission  contributes  to.  Second,  a  major  responsibility  of  the  analyst  is, 
wherever  possible,  to  find  means  of  measuring  quantitatively  each  of  these 


performance  characteristics  so  that  the  various  system  alternatives  may 
subsequently  be  rated  on  how  well  they  meet  these  requirements. 

10.2.3  The  Role  of  the  Cost  Analyst 

In  practice  the  stimulus  to  make  these  careful  definitions  and  trans¬ 
lations  frequently  originates  with  the  cost  analyst's  persistent  efforts 
to  ascertain  the  details  of  the  system  that  he  is  to  cost  (see  Chapter  3). 
Thir  prodding  by  the  cost  analyst  may,  for  Instance,  oblige  the  military 


planr  r  and  the  other  members  of  the  systea  design 


to  more  concretely 


crystaliae  their  notions  relative  to  thresholds  (minimum  acceptable  levels 
of  perforaence)  for  each  of  the  relevent  attributes  of  total  systea 
effectiveness,  and  also  to  speculate  how  much  relative  value  they  place 

I 

on  successive  increments  of  performance  above  these  thresholds. 

Moreover,  if  the  cost  analyst  has  participated  in  many  systea 
analysis  projects  in  the  past  he  will  have  acquired  some  finesse  in 
extracting  and  formulating  these  definitions  and  translations  and  thus 


can  actively  contribute  to  the  process.  Again  in  practice,  an  experienced 
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cost  analyst  sometimes  has  major  responsibility  for  defining,  as  well  as 
for  costing,  certain  support  and  related  requirements. 

10.2.4  The  Impact  o',  Opportunity  Costs 

In  another  important  way  the  costs  analyst's  findings  can  contribute 
importantly  to  establishing  the  client's  goals.  This  contribution  is 
exerted  through  the  limited -resources,  opportunity -cost  principles  dis¬ 
cussed  in  Chapters  1  and  8.  To  reiterate,  in  the  deepest  practical  sense, 
no  goal  has  an  Intrinsic  value  unaffected  by  the  resource  requirements 
(costs)  associated  with  satisfying  the  goal.  Frequently,  if  the  client 
had  initially  established  his  goals  with  no  knowledge  or  seriously 
erroneous  knowledge  relative  to  their  resource  implications,  the  cost 
analyst's  initial  findings  are  likely  to  prompt  substantial  revisions  in 
these  goals.  Thus,  an  anti-missile  defense  is  likely  to  rank  high  on 
the  nation's  list  of  practical  military  system  oojectives  if  such  a 
defense  could  be  achieved  for  $500  million.  The  relative  ranking  of 
such  a  goal  on  a  list  of  practical  military  system  objectives,  as  opposed 
to  a  "nice-to-have"  wishing  list,  is  likely  to  fall  rapidly  if  it  is 
found  that  such  a  capability  would  cost  $500  billion.  This  principle 
applies  with  equal  force  whether  one  is  establishing  objectives  and  re¬ 
quirements  within  the  context  of  a  given  system  or  mission,  or  whether 
one  is  deciding  at  the  broadest  possible  level  what  our  national  goals 

should  be.  The  choice  of  goals  and  the  costs  associated  with  achieving 

2 

these  goals  are  inextricably  bound  together. 

10.3  latabllahlng  Alternatives 

10. 3. I  lliminating  Dominated  Alternatives 

The  cost  analyst  not  only  can  assist  in  establishing  the  client's 
objectives,  he  also  can  participate  in  establishing  system  alternatives 
to  meet  these  objectives. 
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In  the  first  place,  since  the  cost  analyst  is  responsible  for  working 
up  the  costs  for  each  of  the  initially  conceived  system  alternatives,  he 
participates  on  a  working  level  in  spelling  out  the  cost/effectiveness 
trade>offs  of  these  alternatives.  Two  consequences  flow  from  this  trade¬ 
off  analysis.  One.  as  suggested  in  Section  10.2,  the  client  may  revise 
some  of  his  initial  constraints  and  performance  thresholds  when  he  sees 
the  opportunity  costs  posed  by  the  cost/effectiveness  analysis.  Second, 
such  analysis  may  automatically  -  with  little  decision  action  on  the  part 
of  the  client  -  identify  and  elisiinate  from  further  consideration  certain 
dominated  alternatives.  (Alternative  A  dominates  Alternative  B  if  A  is 
superior  to  B  in  at  least  some  cf  the  relevant  system  performance 
characteristics,  is  inferior  to  B  in  no  relevant  performance  characteristic, 
and  costs  no  more  (or  less!  than  B.) 

10. 3. 2  Drafting  Mew  Alternatives 

A  second  major  responsibility  that  the  cost  analyst  and  other  members 
of  the  ayateu  analysis  team  have  is  to  see  that  the  client  is  fully  aware 
of  all  of  his  alternatives.  In  this  connection  they  may  participate  in 
drafting  new  alternatives  not  originally  proposed  or  conceived  by  the 

ji 

client.  This  need  to  establish  new  alternatives  derives  from  the  fact 


that  normally  after  the  analysis  has 


eliminated  from  further  consideration 


the  doadnated  alternatives,  there  ream  in  several  or  numerous  alternatives 
for  which  there  exists  no  clesr-cut  dominance.  In  other  words,  alternative 
X  may  provide  superior  performance  to  alternative  T  in  one  or  sure  charac¬ 
teristic^),  but  provide  inferior  performance  in  sow  other  characteristic (s) 
including  cost.  Before  the  client  attempts  to  choose  one  of  these  alter¬ 
natives,  the  system  analysis  team  asy  sscertsin  whether  some  new  alter¬ 
native^)  can  be  drafted  which  will  combine  some  of  the  best  features  of 
alternatives  X  and  Y  without  offsetting  disadvantages. 
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In  the  drafting  of  such  alternatives,  the  cost  analyst  is  again 
Intimately  involved.  He  will  wake  cost  sensitivity  studiee  that  will 
be  used  to  reorient  the  design  effort.  These  studies  will  ascertain  the 
relative  sensitivity  of  total  system  cost  to  selective  changes  in  the 
values  of  each  of  the  major  system  performance  and  design  characteristics. 
One  result  of  these  cost  sensitivity  studies  my  be  to  reclassify  some  of 
the  original  undominated  alternatives  into  a  dominated  status.  To  take  a 


hypothetical  example,  a  reanalysis  -  including  cost  sensitivity  studies  - 


could  develop  a  new  alternative  MC*  that,  would  doainati 


two  alternatives 


A  and  B  that  originally  were  among  the  undominated  alternatives  in  a  first 
pass  cost/effectiveness  analysis: 


Performance 

Characteristic 

Alternatives  (Index) 


Total 

System  Cost 

_<&a _ 


X  Y 


(Original  Analysis)  t 


A 

100 

70 

100 

B 

75 

80 

!°5 

i 

(Hew  Analysis) 

1  , 

C 

100 

80 

100 

10.4  Selecting  The  Preferred  Alternative 

10.4.1  The  Problem  of  Incoamensurables 

Unless  cost  sensitivity  studies  and  other  design  activities  have 
succeeded  in  discovering  one  system  alternative  that  dominates  all  others, 
the  client  must  decide  which  alternative  on  net  balance  he  prefers.  This 
decision  is  difficult  bee  se  he  has  to  make  a  choice  among  what  system 
analysts  call  incommensurables,  elements  having  no  common  basis  for  corn- 
pari son.  Thus,  in  the  case  of  a  warning  system  he  may  have  to  decide 
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whether  he  prefers  System  A  which  will  provide  e  S  minute  warning  of  ea 
enemy  attack  with  a  99%  reliability  (will  provide  correct  information 
99%  of  the  time)  or  System  B  which  will  provide  a  10  minute  warning  time 
with  e  90%  reliability.  The  difficulty  of  the  choice  is,  of  course, 
increased  if  Systems  A  &  B  also  differ  in  other  important  performance 
areas  and  in  total  cost,  and  for  technical  or  other  reasons  it  is  not 
possible  to  develop  another  alternative  that  will  combine  the  advantages 
of  A  and  B  without  offsetting  disadvantages. 

10.4.2  History.  Judgment,  and  Values 

This  matter  of  selecting  a  preferred  system  among  several  or  numerous 
undominated  alternatives  is  one  of  the  s»st  important  and  most  difficult 
aspects  of  the  military  system  analysis  process.  Historically,  it  is  the 
area  in  which  intuitive,  subjective  factors  -  judgment,  experience,  etc.  - 
have  dominated  the  decision-making  process.  Many  authorities  believe  that 
such  factors  will  (and  should)  always  prevail  over  systematic  analysis 
because  such  decisions  are  intimately  tied  up  with  "values." 

10.4.3  The  Criterion  Issue 

Other  authorities,  however,  believe  that  systematic  analysis  can  do 
much  to  help  the  client  better  apply  his  experience,  judgment,  and  value 
standards.  Hitch  and  McKean,  for  instance,  state  that  ". ..the  selection 
of  an  appropriate  criterion  is  frequently  the  central  problem  in  the  design 

3 

of  an  economic  analysis  Intended  to  improve  military  decisions. "  In  other 
words,  they  regard  it  as  one  of  the  economist's  responsibilities  to  con¬ 
tribute  importantly  to  the  design  of  criteria  on  the  basis  of  which  one 
system  is  chosen  over  another. 

Although  methodologists  (economists,  system  analysts,  operations 
researcher  analysts,  etc.)  have  not  developed  and  agreed  upon  a  set  of 
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universal  criteria  applicable  to  all  situations,  they  are  in  substantial 
agreement  that  certain  criteria  are  better  than  others  and  that  some  of 
the  criteria  frequently  used  by  military  planners  in  the  past  are  basically 

4 

invalid.  In  effect,  this  is  to  say  that  even  with  the  present  undeveloped 
state  of  knowledge,  systematic  analysis  has  something  to  offer  in  this 
really  pivotal  area  of  deciding  upon  what  basis  a  client  will  evaluate  and 
select  one  system  alternative  over  another. 

One  example  may  be  cited:  Military  planners  have  sometimes  selected 
a  preferred  system  on  an  effectiveness/cost  ratio  basis.  They  have  picked 
the  system  which  offered  the  greatest  amount  of  effectiveness  per  dollar 
cost.  This  seemingly  plausible  criterion  is  basically  deficient  in  that 
it  implicitly  assumes  a  linear  relationship  between  coat  and  effectiveness, 
i.e. ,  that  an  alternative  which  is  superior  at  one  level  of  performance 
will  be  superior  at  all  levels.  By  ignoring  the  level  of  performance 
decision,  dils  technique  would,  under  some  conditions,  lead  to  buying 
much  more  performance  than  needed  to  accomplish  a  mission  and,  under  other 
conditions,  provide  much  less  than  a  minimum  required  level  of  performance, 
or  in  die  words  of  Hitch  and  McKean  (op.  cit. ,  p.  166)  to  provide  "...  a 
system  that  would  invite  and  lose  a  war  inexpensively." 

10.5  Su—mrv 

Figuratively  speaking,  there  is  no  end  to  the  possible  applications 
of  explicit,  systematic  analysis  to  the  problem  of  adlitary  system  choice. 
From  the  setting  of  mission  objectives*  the  drafting  and  evaluating  of 
system  alternatives  to  meet  these  objectives*  the  elimination  of  dominated 
eltematives  from  further  consideration  and  the  drafting  of  new  alternatives, 
to  the  critically  important  creation  of  criteria  to  evaluate  the  undominated 
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alternatives  and  to  select  the  preferred  alternative,  the  system  analyst. 
Including  the  cost  analyst  as  a  member  of  an  interdiscipline  system  analysis 
team,  has  a  large  role  to  play.  Whether  and  to  what  extent  this  role  is 
activated  on  a  particular  project  is  a  function,  on  the  one  hand,  of  the 
characteristics  and  constraints  of  the  problem  being  analysed  and,  on  the 
other  hand,  of  the  administrative  ground-rules  governing  the  project. 
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FOOTNOTES 


This  point  is  veil  stated  by  C.  J.  Hitch,  presently  DOD  Comptroller, 
in  "On  the  Choice  of  Objectives  in  System  Studies,"  BAUD  P-1955.  (1960). 


1*1 

17C 


^itch  and  McKean  in  numerous  writings  have  lucidly  established  this  172 

point.  For  instance,  Hitch  op.  cit. :  p.  11,  "The  feedback  on  objectives 
■ay  in  some  cases  be  Che  most  important  result  of  our  study.  We  have  never 
undertaken  a  major  system  study  at  BAMD  in  which  we  were  able  to  define 
satisfactory  objectives  at  the  beginning  of  the  study. "  (Emphasis 
supplied  -  M.V.J.) 


Or.  cit. .  p.  158.  (Emphasis  supplied  -  M.V.J.)  171 

^taitch  and  McKean,  op.  cit.  devote  approximately  30  pages  (pp.  158-87)  171 

to  this  subject. 
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